Jul 29 19:16:48.943036 ip-10-0-136-162 systemd[1]: Starting Kubernetes Kubelet... Jul 29 19:16:49.346482 ip-10-0-136-162 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 19:16:49.346482 ip-10-0-136-162 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 19:16:49.346482 ip-10-0-136-162 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 19:16:49.346482 ip-10-0-136-162 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 19:16:49.346482 ip-10-0-136-162 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 19:16:49.348002 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.347927 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 19:16:49.353791 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353770 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 19:16:49.353791 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353786 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 19:16:49.353791 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353790 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 19:16:49.353791 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353794 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 19:16:49.353791 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353797 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353800 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353803 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353807 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353809 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353812 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353815 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353817 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353820 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353822 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353825 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353827 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353830 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353832 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353835 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353838 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353841 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353843 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353845 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353848 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 19:16:49.353978 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353850 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353857 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353860 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353863 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353865 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353868 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353870 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353873 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353875 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353878 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353881 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353883 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353886 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353888 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353891 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353894 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353897 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353899 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353903 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 19:16:49.354451 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353907 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353910 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353913 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353916 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353918 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353921 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353923 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353926 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353929 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353932 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353934 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353937 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353940 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353942 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353945 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353948 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353950 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353955 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353958 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 19:16:49.354920 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353961 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353963 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353966 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353969 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353972 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353974 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353977 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353980 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353983 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353986 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353989 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353991 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353994 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353997 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.353999 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354002 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354004 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354007 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354010 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354014 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 19:16:49.355375 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354017 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354021 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354025 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354027 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354030 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354033 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354036 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354038 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354041 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354044 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354046 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354049 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354051 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354054 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354056 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354060 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354063 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354789 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354796 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354800 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 19:16:49.355883 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354803 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354807 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354810 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354813 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354815 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354818 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354821 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354823 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354826 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354828 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354831 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354834 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354837 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354839 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354843 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354845 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354848 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354850 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354854 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 19:16:49.356359 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354858 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354861 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354864 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354866 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354868 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354871 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354874 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354877 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354880 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354882 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354885 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354887 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354890 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354894 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354896 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354899 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354901 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354904 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354906 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354909 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 19:16:49.356840 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354911 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354914 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354917 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354921 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354925 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354928 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354931 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354934 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354938 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354940 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354943 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354946 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354948 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354951 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354954 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354956 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354959 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354961 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354964 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 19:16:49.357322 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354966 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354969 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354972 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354975 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354977 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354980 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354983 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354986 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354988 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354991 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354994 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354996 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.354999 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355001 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355004 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355006 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355010 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355012 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355014 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355017 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 19:16:49.357795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355019 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355022 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355025 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355027 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355030 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355032 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355035 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355038 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355041 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355044 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355047 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355050 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355052 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355055 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355058 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355061 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355063 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355066 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355452 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 19:16:49.358269 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355457 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355460 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355463 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355466 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355469 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355471 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355474 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355477 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355480 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355483 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355485 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355488 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355490 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355493 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355496 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355499 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355502 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355506 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355509 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 19:16:49.358722 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355512 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355515 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355518 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355520 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355523 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355525 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355528 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355532 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355535 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355545 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355548 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355551 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355554 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355558 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355561 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355563 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355566 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355569 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355571 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355574 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 19:16:49.359212 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355577 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355580 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355582 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355585 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355588 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355590 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355593 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355598 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355601 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355605 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355608 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355611 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355613 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355616 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355618 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355621 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355624 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355629 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355632 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 19:16:49.359697 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355635 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355639 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355641 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355644 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355647 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355649 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355652 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355655 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355658 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355660 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355663 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355665 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355668 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355671 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355673 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355676 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355678 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355681 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355683 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355686 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 19:16:49.360178 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355691 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355694 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355696 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355699 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355702 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355704 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355707 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355710 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355713 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355715 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355719 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355721 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355741 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355745 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355749 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355753 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355757 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355760 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355762 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.355765 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 19:16:49.360681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355828 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355835 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355842 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355848 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355855 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355859 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355866 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355870 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355874 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355877 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355880 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355884 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355889 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355892 2574 flags.go:64] FLAG: --cgroup-root="" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355895 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355899 2574 flags.go:64] FLAG: --client-ca-file="" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355902 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355906 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355910 2574 flags.go:64] FLAG: --cluster-domain="" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355912 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355916 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355919 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355923 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355927 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 19:16:49.361164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355930 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355932 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355936 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355939 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355942 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355945 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355948 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355951 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355955 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355958 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355961 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355964 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355967 2574 flags.go:64] FLAG: --enable-server="true" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355969 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355974 2574 flags.go:64] FLAG: --event-burst="100" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355977 2574 flags.go:64] FLAG: --event-qps="50" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355979 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355982 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355985 2574 flags.go:64] FLAG: --eviction-hard="" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355989 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355993 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355996 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.355998 2574 flags.go:64] FLAG: --eviction-soft="" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356001 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356004 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 19:16:49.361828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356007 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356010 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356013 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356016 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356018 2574 flags.go:64] FLAG: --feature-gates="" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356025 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356028 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356031 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356034 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356037 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356040 2574 flags.go:64] FLAG: --help="false" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356043 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356046 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356048 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356051 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356054 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356058 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356061 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356063 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356066 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356069 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356072 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356075 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356078 2574 flags.go:64] FLAG: --kube-reserved="" Jul 29 19:16:49.362470 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356080 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356083 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356086 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356089 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356092 2574 flags.go:64] FLAG: --lock-file="" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356095 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356098 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356100 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356106 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356109 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356112 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356115 2574 flags.go:64] FLAG: --logging-format="text" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356118 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356123 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356126 2574 flags.go:64] FLAG: --manifest-url="" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356128 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356132 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356135 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356139 2574 flags.go:64] FLAG: --max-pods="110" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356143 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356146 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356149 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356152 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356155 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356157 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 19:16:49.363065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356160 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356168 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356171 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356174 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356177 2574 flags.go:64] FLAG: --pod-cidr="" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356180 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356186 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356189 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356192 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356195 2574 flags.go:64] FLAG: --port="10250" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356198 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356201 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07fa09f09aa8dd0f2" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356204 2574 flags.go:64] FLAG: --qos-reserved="" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356207 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356210 2574 flags.go:64] FLAG: --register-node="true" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356213 2574 flags.go:64] FLAG: --register-with-taints="" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356216 2574 flags.go:64] FLAG: --registry-burst="10" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356220 2574 flags.go:64] FLAG: --registry-qps="5" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356223 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356226 2574 flags.go:64] FLAG: --reserved-memory="" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356229 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356234 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356237 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356240 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356243 2574 flags.go:64] FLAG: --runonce="false" Jul 29 19:16:49.363681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356246 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356249 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356251 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356254 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356257 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356260 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356263 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356265 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356268 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356271 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356274 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356277 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356280 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356283 2574 flags.go:64] FLAG: --system-cgroups="" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356285 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356291 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356293 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356296 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356300 2574 flags.go:64] FLAG: --tls-min-version="" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356303 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356306 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356308 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356311 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356314 2574 flags.go:64] FLAG: --v="2" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356317 2574 flags.go:64] FLAG: --version="false" Jul 29 19:16:49.364311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356331 2574 flags.go:64] FLAG: --vmodule="" Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356339 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.356342 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356468 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356472 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356475 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356479 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356482 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356484 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356487 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356490 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356493 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356496 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356499 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356502 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356504 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356507 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356509 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356512 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356514 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 19:16:49.364938 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356517 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356520 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356524 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356527 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356531 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356534 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356537 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356540 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356543 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356545 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356548 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356551 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356553 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356557 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356559 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356563 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356566 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356569 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356571 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 19:16:49.365459 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356574 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356576 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356579 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356582 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356584 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356587 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356589 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356592 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356594 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356597 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356599 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356602 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356605 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356607 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356609 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356612 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356616 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356621 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356625 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356628 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 19:16:49.365985 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356631 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356633 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356636 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356638 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356641 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356643 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356646 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356649 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356652 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356655 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356658 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356661 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356663 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356666 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356670 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356673 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356676 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356678 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356681 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356683 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 19:16:49.366480 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356686 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356688 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356691 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356693 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356696 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356698 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356701 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356703 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356706 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356709 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356712 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356715 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356717 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356720 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356722 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356739 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356741 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356744 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356746 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356749 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 19:16:49.366964 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356753 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 19:16:49.367465 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356756 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 19:16:49.367465 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.356759 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 19:16:49.367465 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.357437 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 19:16:49.367465 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.363708 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 19:16:49.367465 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.363735 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 19:16:49.367465 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.363757 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 19:16:49.367465 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.363763 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 19:16:49.367465 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363816 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 19:16:49.367465 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363821 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 19:16:49.367465 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363826 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 19:16:49.367465 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363830 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 19:16:49.367465 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363833 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 19:16:49.367465 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363837 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 19:16:49.367465 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363840 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363843 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363846 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363848 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363851 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363853 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363856 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363859 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363861 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363865 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363869 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363872 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363874 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363877 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363879 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363882 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363884 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363887 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363889 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363892 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 19:16:49.367836 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363894 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363897 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363899 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363903 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363907 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363910 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363912 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363915 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363917 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363920 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363922 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363925 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363927 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363930 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363933 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363936 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363938 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363941 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363944 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 19:16:49.368305 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363947 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363949 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363952 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363954 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363957 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363960 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363962 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363965 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363967 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363970 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363973 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363976 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363978 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363981 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363983 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363986 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363989 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363993 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363995 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.363998 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 19:16:49.368871 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364000 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364003 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364006 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364008 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364011 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364013 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364016 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364018 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364021 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364023 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364026 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364028 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364031 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364034 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364036 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364039 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364042 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364046 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364049 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364052 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 19:16:49.369347 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364055 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 19:16:49.370066 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364058 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 19:16:49.370066 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364061 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 19:16:49.370066 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364064 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 19:16:49.370066 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364066 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 19:16:49.370066 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364069 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 19:16:49.370066 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364071 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 19:16:49.370066 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364074 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 19:16:49.370066 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364077 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 19:16:49.370066 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364079 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 19:16:49.370066 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364083 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 19:16:49.370066 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364085 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 19:16:49.370066 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364088 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 19:16:49.370066 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364090 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 19:16:49.370066 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.364095 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 19:16:49.370066 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364206 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364210 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364213 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364216 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364219 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364222 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364224 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364227 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364229 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364232 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364234 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364237 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364239 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364242 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364245 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364247 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364250 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364252 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364255 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364257 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 19:16:49.370611 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364260 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364262 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364265 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364267 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364270 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364273 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364275 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364278 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364281 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364283 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364286 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364288 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364291 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364293 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364296 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364298 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364301 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364303 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364306 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 19:16:49.371302 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364308 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364311 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364313 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364316 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364318 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364321 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364324 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364327 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364332 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364335 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364338 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364341 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364343 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364346 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364350 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364353 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364355 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364358 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364361 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 19:16:49.372014 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364363 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364366 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364369 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364372 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364375 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364377 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364380 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364382 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364384 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364387 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364390 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364392 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364394 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364397 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364400 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364403 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364406 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364408 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364411 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364413 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 19:16:49.372568 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364416 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364419 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364421 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364424 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364427 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364429 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364432 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364434 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364436 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364439 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364442 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364444 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364447 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364449 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364453 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364456 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364460 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364463 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364465 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364468 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 19:16:49.373082 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:49.364470 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 19:16:49.373567 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.364476 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 19:16:49.373567 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.364568 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 19:16:49.373567 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.367168 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 19:16:49.373567 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.368490 2574 server.go:1019] "Starting client certificate rotation" Jul 29 19:16:49.373567 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.368604 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 19:16:49.373567 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.368654 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 19:16:49.373567 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.371081 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 19:16:49.373567 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.372568 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 19:16:49.382581 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.382566 2574 log.go:25] "Validated CRI v1 runtime API" Jul 29 19:16:49.384585 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.384571 2574 log.go:25] "Validated CRI v1 image API" Jul 29 19:16:49.386381 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.386361 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 19:16:49.389030 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.389013 2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ae9b46c6-4469-4f91-9b7f-bec1aa2bd972:/dev/nvme0n1p4 b78151f5-2610-4c69-9b68-bd28a0b40303:/dev/nvme0n1p3] Jul 29 19:16:49.389097 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.389030 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 19:16:49.395462 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.395353 2574 manager.go:216] Machine: {Timestamp:2026-07-29 19:16:49.394048531 +0000 UTC m=+0.336139137 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3064820 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26fde2e1b110739bce6120c641dc41 SystemUUID:ec26fde2-e1b1-1073-9bce-6120c641dc41 BootID:1e914ab5-e9dd-4a6d-8bfe-01a8e5139131 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d8:2a:60:25:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d8:2a:60:25:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:99:b3:fd:5b:75 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 19:16:49.395462 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.395452 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 19:16:49.395636 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.395577 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 19:16:49.397849 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.397833 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 19:16:49.398654 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.398632 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 19:16:49.398797 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.398658 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 19:16:49.399968 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.399957 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 19:16:49.400008 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.399970 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 19:16:49.400008 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.399977 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 19:16:49.400553 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.400544 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 19:16:49.401524 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.401513 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 19:16:49.403172 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.403161 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 29 19:16:49.403276 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.403266 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 19:16:49.403314 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.403297 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 29 19:16:49.403314 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.403306 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 19:16:49.403375 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.403319 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 19:16:49.403375 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.403329 2574 kubelet.go:398] "Adding apiserver pod source" Jul 29 19:16:49.403375 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.403337 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 19:16:49.403670 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.403658 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 19:16:49.403737 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.403676 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 19:16:49.406086 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.406069 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 19:16:49.407932 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.407918 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 19:16:49.407995 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.407948 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 19:16:49.409958 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.409945 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 19:16:49.410011 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.409964 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 19:16:49.410011 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.409970 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 19:16:49.410011 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.409975 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 19:16:49.410011 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.409984 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 19:16:49.410011 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.409992 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 19:16:49.410011 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.410003 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 19:16:49.410011 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.410009 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 19:16:49.410192 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.410015 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 19:16:49.410192 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.410021 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 19:16:49.410192 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.410029 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 19:16:49.410192 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.410035 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 19:16:49.411499 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.411468 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 19:16:49.411600 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.411494 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 19:16:49.411600 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.411521 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 19:16:49.411600 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.411532 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 19:16:49.414423 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.414407 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-162.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 19:16:49.414760 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.414747 2574 server.go:1268] "Started kubelet" Jul 29 19:16:49.414890 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.414836 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 19:16:49.414987 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.414876 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 19:16:49.414987 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.414937 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 19:16:49.415481 ip-10-0-136-162 systemd[1]: Started Kubernetes Kubelet. Jul 29 19:16:49.416471 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.416455 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 19:16:49.417248 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.417233 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 29 19:16:49.420306 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.420290 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 19:16:49.424485 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.424465 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 19:16:49.424579 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.424485 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 19:16:49.424579 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.424533 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found" Jul 29 19:16:49.425076 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.425057 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 19:16:49.425153 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.425066 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 19:16:49.425153 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.425105 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 19:16:49.425256 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.425239 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 29 19:16:49.425256 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.425248 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 29 19:16:49.425350 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.425270 2574 factory.go:55] Registering systemd factory Jul 29 19:16:49.425350 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.425285 2574 factory.go:223] Registration of the systemd container factory successfully Jul 29 19:16:49.425513 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.425495 2574 factory.go:153] Registering CRI-O factory Jul 29 19:16:49.425513 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.425512 2574 factory.go:223] Registration of the crio container factory successfully Jul 29 19:16:49.425657 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.425551 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 19:16:49.425657 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.424526 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c6d8bd32fadc42 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-07-29 19:16:49.414700098 +0000 UTC m=+0.356790705,LastTimestamp:2026-07-29 19:16:49.414700098 +0000 UTC m=+0.356790705,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}" Jul 29 19:16:49.425657 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.425573 2574 factory.go:103] Registering Raw factory Jul 29 19:16:49.425657 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.425588 2574 manager.go:1196] Started watching for new ooms in manager Jul 29 19:16:49.426075 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.426063 2574 manager.go:349] Starting recovery of all containers Jul 29 19:16:49.429663 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.429634 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 19:16:49.434099 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.434071 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 19:16:49.437399 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.437382 2574 manager.go:354] Recovery completed Jul 29 19:16:49.441800 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.441786 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 19:16:49.443783 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.443759 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory" Jul 29 19:16:49.443840 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.443791 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 19:16:49.443840 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.443802 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID" Jul 29 19:16:49.444313 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.444303 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 19:16:49.444313 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.444313 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 19:16:49.444381 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.444326 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 29 19:16:49.444581 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.444568 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 19:16:49.445241 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.445223 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory" Jul 29 19:16:49.445310 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.445254 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 19:16:49.445310 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.445269 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID" Jul 29 19:16:49.445892 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.445817 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c6d8bd34b69fce default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-162.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-07-29 19:16:49.443782606 +0000 UTC m=+0.385873212,LastTimestamp:2026-07-29 19:16:49.443782606 +0000 UTC m=+0.385873212,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}" Jul 29 19:16:49.446109 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.446096 2574 policy_none.go:49] "None policy: Start" Jul 29 19:16:49.446153 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.446120 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 19:16:49.446153 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.446131 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 19:16:49.447349 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.447336 2574 policy_none.go:47] "Start" Jul 29 19:16:49.448880 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.448866 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tn99x" Jul 29 19:16:49.456589 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.456529 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c6d8bd34b6d456 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-162.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-07-29 19:16:49.443796054 +0000 UTC m=+0.385886660,LastTimestamp:2026-07-29 19:16:49.443796054 +0000 UTC m=+0.385886660,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}" Jul 29 19:16:49.461279 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.461255 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tn99x" Jul 29 19:16:49.465779 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.465683 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c6d8bd34b6f943 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-162.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-07-29 19:16:49.443805507 +0000 UTC m=+0.385896113,LastTimestamp:2026-07-29 19:16:49.443805507 +0000 UTC m=+0.385896113,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}" Jul 29 19:16:49.470288 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.470271 2574 manager.go:337] "Starting Device Plugin manager" Jul 29 19:16:49.470365 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.470305 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 19:16:49.470365 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.470318 2574 server.go:87] "Starting device plugin registration server" Jul 29 19:16:49.470557 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.470545 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 19:16:49.470608 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.470560 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 19:16:49.470656 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.470641 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 19:16:49.470810 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.470719 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 19:16:49.470810 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.470745 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 19:16:49.471353 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.471243 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 19:16:49.471353 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.471291 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-162.ec2.internal\" not found" Jul 29 19:16:49.475942 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.475872 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-162.ec2.internal.18c6d8bd34b69fce\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c6d8bd34b69fce default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-162.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-07-29 19:16:49.443782606 +0000 UTC m=+0.385873212,LastTimestamp:2026-07-29 19:16:49.445240155 +0000 UTC m=+0.387330764,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}" Jul 29 19:16:49.486960 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.486905 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-162.ec2.internal.18c6d8bd34b6d456\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c6d8bd34b6d456 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-162.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-07-29 19:16:49.443796054 +0000 UTC m=+0.385886660,LastTimestamp:2026-07-29 19:16:49.445261184 +0000 UTC m=+0.387351791,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}" Jul 29 19:16:49.494501 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.494442 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-162.ec2.internal.18c6d8bd34b6f943\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c6d8bd34b6f943 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-162.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-07-29 19:16:49.443805507 +0000 UTC m=+0.385896113,LastTimestamp:2026-07-29 19:16:49.445275476 +0000 UTC m=+0.387366083,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}" Jul 29 19:16:49.505972 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.505914 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c6d8bd366d42d9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-07-29 19:16:49.472529113 +0000 UTC m=+0.414619706,LastTimestamp:2026-07-29 19:16:49.472529113 +0000 UTC m=+0.414619706,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}" Jul 29 19:16:49.571289 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.571268 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 19:16:49.572188 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.572175 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory" Jul 29 19:16:49.572270 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.572207 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 19:16:49.572270 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.572221 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID" Jul 29 19:16:49.572270 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.572253 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.581831 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.581757 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-162.ec2.internal.18c6d8bd34b69fce\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c6d8bd34b69fce default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-162.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-07-29 19:16:49.443782606 +0000 UTC m=+0.385873212,LastTimestamp:2026-07-29 19:16:49.572189821 +0000 UTC m=+0.514280433,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}" Jul 29 19:16:49.585270 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.585216 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-162.ec2.internal.18c6d8bd34b6d456\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c6d8bd34b6d456 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-162.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-07-29 19:16:49.443796054 +0000 UTC m=+0.385886660,LastTimestamp:2026-07-29 19:16:49.572214067 +0000 UTC m=+0.514304673,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}" Jul 29 19:16:49.585417 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.585400 2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-136-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.588925 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.588842 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-162.ec2.internal.18c6d8bd34b6f943\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c6d8bd34b6f943 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-162.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-07-29 19:16:49.443805507 +0000 UTC m=+0.385896113,LastTimestamp:2026-07-29 19:16:49.572228174 +0000 UTC m=+0.514318783,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}" Jul 29 19:16:49.636975 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.636945 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms" Jul 29 19:16:49.672098 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.672066 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 19:16:49.673276 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.673260 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 19:16:49.673351 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.673296 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 19:16:49.673351 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.673315 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 19:16:49.673351 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.673349 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 19:16:49.683482 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.683465 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 19:16:49.774197 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.774158 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal"] Jul 29 19:16:49.774290 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.774245 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 19:16:49.777741 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.776291 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory" Jul 29 19:16:49.777741 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.776344 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 19:16:49.777741 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.776368 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID" Jul 29 19:16:49.778385 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.778370 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 19:16:49.778495 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.778477 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.778533 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.778511 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 19:16:49.779147 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.779132 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory" Jul 29 19:16:49.779198 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.779161 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 19:16:49.779198 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.779161 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory" Jul 29 19:16:49.779198 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.779190 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 19:16:49.779198 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.779199 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID" Jul 29 19:16:49.779334 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.779175 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID" Jul 29 19:16:49.780515 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.780497 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.780598 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.780522 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 19:16:49.781158 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.781143 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory" Jul 29 19:16:49.781218 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.781167 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 19:16:49.781218 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.781177 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID" Jul 29 19:16:49.786368 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.786356 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 19:16:49.787024 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.787011 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory" Jul 29 19:16:49.787093 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.787033 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 19:16:49.787093 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.787042 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID" Jul 29 19:16:49.787093 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.787060 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.794995 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.794983 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.795039 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.795000 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-162.ec2.internal\": node \"ip-10-0-136-162.ec2.internal\" not found" Jul 29 19:16:49.803367 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.803349 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-162.ec2.internal\" not found" node="ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.807785 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.807772 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-162.ec2.internal\" not found" node="ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.824661 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.824645 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found" Jul 29 19:16:49.828694 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.828677 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e26e3999a322700a50986239dc7d13f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal\" (UID: \"e26e3999a322700a50986239dc7d13f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.828757 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.828701 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63bcc45c5ec23bde54a6545b8958739b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-162.ec2.internal\" (UID: \"63bcc45c5ec23bde54a6545b8958739b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.828757 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.828717 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e26e3999a322700a50986239dc7d13f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal\" (UID: \"e26e3999a322700a50986239dc7d13f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.924870 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:49.924815 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found" Jul 29 19:16:49.929040 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.929027 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63bcc45c5ec23bde54a6545b8958739b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-162.ec2.internal\" (UID: \"63bcc45c5ec23bde54a6545b8958739b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.929102 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.929048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e26e3999a322700a50986239dc7d13f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal\" (UID: \"e26e3999a322700a50986239dc7d13f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.929102 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.929065 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e26e3999a322700a50986239dc7d13f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal\" (UID: \"e26e3999a322700a50986239dc7d13f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.929168 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.929101 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e26e3999a322700a50986239dc7d13f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal\" (UID: \"e26e3999a322700a50986239dc7d13f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.929168 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.929141 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63bcc45c5ec23bde54a6545b8958739b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-162.ec2.internal\" (UID: \"63bcc45c5ec23bde54a6545b8958739b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal" Jul 29 19:16:49.929226 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:49.929141 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e26e3999a322700a50986239dc7d13f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal\" (UID: \"e26e3999a322700a50986239dc7d13f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" Jul 29 19:16:50.025041 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:50.025012 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found" Jul 29 19:16:50.106884 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:50.106848 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal" Jul 29 19:16:50.111572 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:50.111552 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" Jul 29 19:16:50.125454 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:50.125338 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found" Jul 29 19:16:50.225833 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:50.225755 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found" Jul 29 19:16:51.379996 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:51.379964 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found" Jul 29 19:16:51.422278 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.422250 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 19:16:51.422667 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.422401 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 19:16:51.449928 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.449904 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 19:16:51.480563 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:51.480539 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found" Jul 29 19:16:51.552536 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.552449 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 19:16:51.553451 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.553434 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory" Jul 29 19:16:51.553573 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.553467 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 19:16:51.553573 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.553483 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID" Jul 29 19:16:51.580626 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:51.580599 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found" Jul 29 19:16:51.600365 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.600343 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 19:16:51.649904 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.649861 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 19:11:50 +0000 UTC" deadline="2028-01-18 13:29:02.383459942 +0000 UTC" Jul 29 19:16:51.649904 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.649892 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12906h12m10.73357077s" Jul 29 19:16:51.681187 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:51.681159 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found" Jul 29 19:16:51.708652 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:51.708618 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode26e3999a322700a50986239dc7d13f1.slice/crio-2fe9f676c6b6400cfba09de4251faa1282466e05bf9570f9ac32ac0acda9e25c WatchSource:0}: Error finding container 2fe9f676c6b6400cfba09de4251faa1282466e05bf9570f9ac32ac0acda9e25c: Status 404 returned error can't find the container with id 2fe9f676c6b6400cfba09de4251faa1282466e05bf9570f9ac32ac0acda9e25c Jul 29 19:16:51.709406 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:51.709384 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63bcc45c5ec23bde54a6545b8958739b.slice/crio-ed87f82d1eff0a93cbc60483a760dbd388f592e067b58a75d7bab7ab956e6fc3 WatchSource:0}: Error finding container ed87f82d1eff0a93cbc60483a760dbd388f592e067b58a75d7bab7ab956e6fc3: Status 404 returned error can't find the container with id ed87f82d1eff0a93cbc60483a760dbd388f592e067b58a75d7bab7ab956e6fc3 Jul 29 19:16:51.715846 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.715831 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 19:16:51.729866 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.729828 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" event={"ID":"e26e3999a322700a50986239dc7d13f1","Type":"ContainerStarted","Data":"2fe9f676c6b6400cfba09de4251faa1282466e05bf9570f9ac32ac0acda9e25c"} Jul 29 19:16:51.730874 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.730854 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal" event={"ID":"63bcc45c5ec23bde54a6545b8958739b","Type":"ContainerStarted","Data":"ed87f82d1eff0a93cbc60483a760dbd388f592e067b58a75d7bab7ab956e6fc3"} Jul 29 19:16:51.782181 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:51.782151 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found" Jul 29 19:16:51.807647 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.807603 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 19:16:51.879157 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.879133 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal" Jul 29 19:16:51.892433 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.892416 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 19:16:51.893591 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.893578 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" Jul 29 19:16:51.908485 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:51.908467 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 19:16:52.458047 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.458014 2574 apiserver.go:52] "Watching apiserver" Jul 29 19:16:52.463164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.463139 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 19:16:52.463749 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.463691 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb","openshift-cluster-node-tuning-operator/tuned-tm646","openshift-dns/node-resolver-m4qwh","openshift-image-registry/node-ca-5wg8l","openshift-multus/multus-additional-cni-plugins-n6c27","openshift-multus/network-metrics-daemon-tvjjw","openshift-network-operator/iptables-alerter-fmtks","kube-system/global-pull-secret-syncer-7plmd","kube-system/konnectivity-agent-7s2ld","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal","openshift-multus/multus-t6b8t","openshift-network-diagnostics/network-check-target-9gg2k","openshift-ovn-kubernetes/ovnkube-node-dxx86","kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal"] Jul 29 19:16:52.465191 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.465168 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fmtks" Jul 29 19:16:52.466737 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.466717 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.467207 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.467189 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nlf74\"" Jul 29 19:16:52.467293 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.467274 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 19:16:52.467364 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.467346 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 19:16:52.467413 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.467398 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 19:16:52.468669 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.468646 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 19:16:52.469221 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.468929 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 19:16:52.469221 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.469148 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 19:16:52.469221 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.469161 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mnnpm\"" Jul 29 19:16:52.471053 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.469794 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.471858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.471262 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5wg8l" Jul 29 19:16:52.471858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.471688 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 19:16:52.471858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.471687 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 19:16:52.472531 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.472250 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gvfqr\"" Jul 29 19:16:52.474429 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.473651 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.474429 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.473954 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 19:16:52.474429 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.474033 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 19:16:52.474429 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.474149 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t2h9c\"" Jul 29 19:16:52.474429 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.474268 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 19:16:52.475542 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.475429 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 19:16:52.477131 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.476956 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:16:52.477131 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:52.477034 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:16:52.477486 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.477466 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 19:16:52.477636 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.477614 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 19:16:52.477707 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.477646 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g6hf5\"" Jul 29 19:16:52.477805 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.477786 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 19:16:52.477900 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.477536 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 19:16:52.477900 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.477576 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 19:16:52.478340 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.478322 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7s2ld" Jul 29 19:16:52.478712 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.478695 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 19:16:52.481752 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.479860 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.481752 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.480286 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 19:16:52.481752 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.480381 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j9lch\"" Jul 29 19:16:52.481752 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.481569 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m4qwh" Jul 29 19:16:52.483089 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.483065 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 19:16:52.483176 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.483139 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 19:16:52.483339 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.483321 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 19:16:52.483453 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.483437 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 19:16:52.483565 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.483549 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 19:16:52.483638 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.483609 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 19:16:52.483742 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.483725 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dnhfq\"" Jul 29 19:16:52.483828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.483812 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 19:16:52.483885 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.483734 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nbnlk\"" Jul 29 19:16:52.483998 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.483983 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.484351 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.483991 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 19:16:52.485447 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.485350 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:16:52.485559 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:52.485421 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:16:52.486107 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.486090 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4c5xf\"" Jul 29 19:16:52.486619 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.486586 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:16:52.486750 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:52.486641 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:16:52.486847 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.486834 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 19:16:52.487739 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.487641 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 19:16:52.490352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.489740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-run-ovn\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.490352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.489769 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-log-socket\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.490352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.489792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-host\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.490352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.489838 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-tmp\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.490352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.489870 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-device-dir\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.490352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.489895 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-ovn-node-metrics-cert\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.490352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.489928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh99n\" (UniqueName: \"kubernetes.io/projected/08faa4de-239e-43a9-a111-f9d490a0710d-kube-api-access-fh99n\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.490352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.489952 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-sys-fs\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.490352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.489979 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs\") pod \"network-metrics-daemon-tvjjw\" (UID: \"8dd28ca5-aeb7-4eb9-b38d-827f82b57d61\") " pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:16:52.490352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490006 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/08faa4de-239e-43a9-a111-f9d490a0710d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.490352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490031 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-ovnkube-config\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.490352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490057 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08faa4de-239e-43a9-a111-f9d490a0710d-system-cni-dir\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.490352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490102 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-socket-dir\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.490352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490137 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-cni-netd\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.490352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490161 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-ovnkube-script-lib\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.490352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490184 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-var-lib-kubelet\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.491083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-modprobe-d\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.491083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490231 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08faa4de-239e-43a9-a111-f9d490a0710d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.491083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490257 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjpxs\" (UniqueName: \"kubernetes.io/projected/9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5-kube-api-access-bjpxs\") pod \"iptables-alerter-fmtks\" (UID: \"9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5\") " pod="openshift-network-operator/iptables-alerter-fmtks" Jul 29 19:16:52.491083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490279 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n75z\" (UniqueName: \"kubernetes.io/projected/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-kube-api-access-6n75z\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.491083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490302 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-run-netns\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.491083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490327 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08faa4de-239e-43a9-a111-f9d490a0710d-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.491083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490349 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-sysconfig\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.491083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490370 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-kubernetes\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.491083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490391 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-run\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.491083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490412 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0fb4252c-4795-40b7-8f5e-e1f540f9ec8b-serviceca\") pod \"node-ca-5wg8l\" (UID: \"0fb4252c-4795-40b7-8f5e-e1f540f9ec8b\") " pod="openshift-image-registry/node-ca-5wg8l" Jul 29 19:16:52.491083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5-iptables-alerter-script\") pod \"iptables-alerter-fmtks\" (UID: \"9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5\") " pod="openshift-network-operator/iptables-alerter-fmtks" Jul 29 19:16:52.491083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490483 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-kubelet\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.491083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490560 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-run-systemd\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.491083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490582 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-sys\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.491083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490606 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9e56c811-fd8f-47a4-a92c-44bd94993dce-konnectivity-ca\") pod \"konnectivity-agent-7s2ld\" (UID: \"9e56c811-fd8f-47a4-a92c-44bd94993dce\") " pod="kube-system/konnectivity-agent-7s2ld" Jul 29 19:16:52.491083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490645 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08faa4de-239e-43a9-a111-f9d490a0710d-os-release\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.491871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490680 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-run-ovn-kubernetes\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.491871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-sysctl-d\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.491871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5-host-slash\") pod \"iptables-alerter-fmtks\" (UID: \"9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5\") " pod="openshift-network-operator/iptables-alerter-fmtks" Jul 29 19:16:52.491871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490750 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-slash\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.491871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490772 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-run-openvswitch\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.491871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490798 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08faa4de-239e-43a9-a111-f9d490a0710d-cnibin\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.491871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490818 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/08faa4de-239e-43a9-a111-f9d490a0710d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.491871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490834 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-node-log\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.491871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490848 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-cni-bin\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.491871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490862 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7zjb\" (UniqueName: \"kubernetes.io/projected/0fb4252c-4795-40b7-8f5e-e1f540f9ec8b-kube-api-access-w7zjb\") pod \"node-ca-5wg8l\" (UID: \"0fb4252c-4795-40b7-8f5e-e1f540f9ec8b\") " pod="openshift-image-registry/node-ca-5wg8l" Jul 29 19:16:52.491871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-var-lib-openvswitch\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.491871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490903 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-env-overrides\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.491871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490930 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-sysctl-conf\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.491871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb888\" (UniqueName: \"kubernetes.io/projected/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-kube-api-access-nb888\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.491871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.490981 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0fb4252c-4795-40b7-8f5e-e1f540f9ec8b-host\") pod \"node-ca-5wg8l\" (UID: \"0fb4252c-4795-40b7-8f5e-e1f540f9ec8b\") " pod="openshift-image-registry/node-ca-5wg8l" Jul 29 19:16:52.491871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.491004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr9mb\" (UniqueName: \"kubernetes.io/projected/e81e9dc9-feaa-4613-ba05-0053b871b648-kube-api-access-pr9mb\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.492666 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.491026 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-lib-modules\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.492666 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.491047 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-systemd\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.492666 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.491073 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-tuned\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.492666 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.491090 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.492666 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.491110 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-registration-dir\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.492666 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.491125 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.492666 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.491140 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntq7p\" (UniqueName: \"kubernetes.io/projected/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-kube-api-access-ntq7p\") pod \"network-metrics-daemon-tvjjw\" (UID: \"8dd28ca5-aeb7-4eb9-b38d-827f82b57d61\") " pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:16:52.492666 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.491155 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9e56c811-fd8f-47a4-a92c-44bd94993dce-agent-certs\") pod \"konnectivity-agent-7s2ld\" (UID: \"9e56c811-fd8f-47a4-a92c-44bd94993dce\") " pod="kube-system/konnectivity-agent-7s2ld" Jul 29 19:16:52.492666 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.491184 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-etc-selinux\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.492666 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.491226 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-systemd-units\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.492666 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.491256 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-etc-openvswitch\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.511827 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.511803 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2gvjs" Jul 29 19:16:52.520081 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.520061 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2gvjs" Jul 29 19:16:52.583743 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.581030 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 19:16:52.591551 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591401 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5-host-slash\") pod \"iptables-alerter-fmtks\" (UID: \"9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5\") " pod="openshift-network-operator/iptables-alerter-fmtks" Jul 29 19:16:52.591551 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591439 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-slash\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.591551 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591463 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-run-openvswitch\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.591551 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591492 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr7l6\" (UniqueName: \"kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6\") pod \"network-check-target-9gg2k\" (UID: \"ca94bfdc-31fd-44d4-a87a-a507fa3ef39c\") " pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:16:52.591551 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591527 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5-host-slash\") pod \"iptables-alerter-fmtks\" (UID: \"9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5\") " pod="openshift-network-operator/iptables-alerter-fmtks" Jul 29 19:16:52.591858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591535 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08faa4de-239e-43a9-a111-f9d490a0710d-cnibin\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.591858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591572 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08faa4de-239e-43a9-a111-f9d490a0710d-cnibin\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.591858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591593 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/08faa4de-239e-43a9-a111-f9d490a0710d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.591858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591613 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-slash\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.591858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591621 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-node-log\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.591858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591645 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-cni-bin\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.591858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591670 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7zjb\" (UniqueName: \"kubernetes.io/projected/0fb4252c-4795-40b7-8f5e-e1f540f9ec8b-kube-api-access-w7zjb\") pod \"node-ca-5wg8l\" (UID: \"0fb4252c-4795-40b7-8f5e-e1f540f9ec8b\") " pod="openshift-image-registry/node-ca-5wg8l" Jul 29 19:16:52.591858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591683 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-node-log\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.591858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-var-lib-openvswitch\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.591858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591717 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-env-overrides\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.591858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591742 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-var-lib-kubelet\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.591858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591767 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-sysctl-conf\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.591858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591791 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb888\" (UniqueName: \"kubernetes.io/projected/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-kube-api-access-nb888\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.591858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591816 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44e454bf-8721-4247-b10c-9eb4f1d850b1-tmp-dir\") pod \"node-resolver-m4qwh\" (UID: \"44e454bf-8721-4247-b10c-9eb4f1d850b1\") " pod="openshift-dns/node-resolver-m4qwh" Jul 29 19:16:52.591858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591840 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-os-release\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591889 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9521677d-7019-45f6-8e84-472a86d51c00-dbus\") pod \"global-pull-secret-syncer-7plmd\" (UID: \"9521677d-7019-45f6-8e84-472a86d51c00\") " pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591916 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0fb4252c-4795-40b7-8f5e-e1f540f9ec8b-host\") pod \"node-ca-5wg8l\" (UID: \"0fb4252c-4795-40b7-8f5e-e1f540f9ec8b\") " pod="openshift-image-registry/node-ca-5wg8l" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591939 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr9mb\" (UniqueName: \"kubernetes.io/projected/e81e9dc9-feaa-4613-ba05-0053b871b648-kube-api-access-pr9mb\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591964 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-run-multus-certs\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591988 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-lib-modules\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592010 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-systemd\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592033 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-tuned\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592056 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592080 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-registration-dir\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592107 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592132 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-multus-socket-dir-parent\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592181 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-run-netns\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592206 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntq7p\" (UniqueName: \"kubernetes.io/projected/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-kube-api-access-ntq7p\") pod \"network-metrics-daemon-tvjjw\" (UID: \"8dd28ca5-aeb7-4eb9-b38d-827f82b57d61\") " pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592231 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9e56c811-fd8f-47a4-a92c-44bd94993dce-agent-certs\") pod \"konnectivity-agent-7s2ld\" (UID: \"9e56c811-fd8f-47a4-a92c-44bd94993dce\") " pod="kube-system/konnectivity-agent-7s2ld" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592256 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-etc-selinux\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592259 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/08faa4de-239e-43a9-a111-f9d490a0710d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.592660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-systemd-units\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592311 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-etc-openvswitch\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592363 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-etc-openvswitch\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592404 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592620 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-lib-modules\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592637 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-cni-bin\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.591648 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-run-openvswitch\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592675 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-systemd\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592852 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-var-lib-openvswitch\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592863 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-registration-dir\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592862 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592907 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592939 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-etc-selinux\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.592978 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-systemd-units\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593091 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-sysctl-conf\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593316 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-env-overrides\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593339 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0fb4252c-4795-40b7-8f5e-e1f540f9ec8b-host\") pod \"node-ca-5wg8l\" (UID: \"0fb4252c-4795-40b7-8f5e-e1f540f9ec8b\") " pod="openshift-image-registry/node-ca-5wg8l" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593372 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-run-ovn\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.593480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593406 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-log-socket\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593431 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44e454bf-8721-4247-b10c-9eb4f1d850b1-hosts-file\") pod \"node-resolver-m4qwh\" (UID: \"44e454bf-8721-4247-b10c-9eb4f1d850b1\") " pod="openshift-dns/node-resolver-m4qwh" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593454 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-host\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593474 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-tmp\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593497 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-device-dir\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593524 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-log-socket\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593537 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-ovn-node-metrics-cert\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-system-cni-dir\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593569 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-run-ovn\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-run-k8s-cni-cncf-io\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593610 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-var-lib-cni-multus\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh99n\" (UniqueName: \"kubernetes.io/projected/08faa4de-239e-43a9-a111-f9d490a0710d-kube-api-access-fh99n\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-sys-fs\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593683 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-multus-conf-dir\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593708 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs\") pod \"network-metrics-daemon-tvjjw\" (UID: \"8dd28ca5-aeb7-4eb9-b38d-827f82b57d61\") " pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593732 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/08faa4de-239e-43a9-a111-f9d490a0710d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593755 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-ovnkube-config\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.594328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593783 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-cnibin\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593807 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08faa4de-239e-43a9-a111-f9d490a0710d-system-cni-dir\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-socket-dir\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593854 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-cni-netd\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-ovnkube-script-lib\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593898 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-etc-kubernetes\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593922 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret\") pod \"global-pull-secret-syncer-7plmd\" (UID: \"9521677d-7019-45f6-8e84-472a86d51c00\") " pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593945 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-var-lib-kubelet\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593973 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-modprobe-d\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.593998 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08faa4de-239e-43a9-a111-f9d490a0710d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594022 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjpxs\" (UniqueName: \"kubernetes.io/projected/9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5-kube-api-access-bjpxs\") pod \"iptables-alerter-fmtks\" (UID: \"9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5\") " pod="openshift-network-operator/iptables-alerter-fmtks" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594051 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/24eb0b3d-db69-436a-8e65-009a7a0f0fba-multus-daemon-config\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594076 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n75z\" (UniqueName: \"kubernetes.io/projected/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-kube-api-access-6n75z\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594102 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-run-netns\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594132 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24eb0b3d-db69-436a-8e65-009a7a0f0fba-cni-binary-copy\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-hostroot\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594178 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmsl2\" (UniqueName: \"kubernetes.io/projected/24eb0b3d-db69-436a-8e65-009a7a0f0fba-kube-api-access-fmsl2\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.595274 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08faa4de-239e-43a9-a111-f9d490a0710d-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-sysconfig\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594251 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-kubernetes\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594274 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-run\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594298 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0fb4252c-4795-40b7-8f5e-e1f540f9ec8b-serviceca\") pod \"node-ca-5wg8l\" (UID: \"0fb4252c-4795-40b7-8f5e-e1f540f9ec8b\") " pod="openshift-image-registry/node-ca-5wg8l" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594321 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5-iptables-alerter-script\") pod \"iptables-alerter-fmtks\" (UID: \"9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5\") " pod="openshift-network-operator/iptables-alerter-fmtks" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-kubelet\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594376 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-run-systemd\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594399 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-sys\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594422 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dfzm\" (UniqueName: \"kubernetes.io/projected/44e454bf-8721-4247-b10c-9eb4f1d850b1-kube-api-access-5dfzm\") pod \"node-resolver-m4qwh\" (UID: \"44e454bf-8721-4247-b10c-9eb4f1d850b1\") " pod="openshift-dns/node-resolver-m4qwh" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594448 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-multus-cni-dir\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594470 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-var-lib-cni-bin\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594494 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9521677d-7019-45f6-8e84-472a86d51c00-kubelet-config\") pod \"global-pull-secret-syncer-7plmd\" (UID: \"9521677d-7019-45f6-8e84-472a86d51c00\") " pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594538 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9e56c811-fd8f-47a4-a92c-44bd94993dce-konnectivity-ca\") pod \"konnectivity-agent-7s2ld\" (UID: \"9e56c811-fd8f-47a4-a92c-44bd94993dce\") " pod="kube-system/konnectivity-agent-7s2ld" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594564 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08faa4de-239e-43a9-a111-f9d490a0710d-os-release\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594592 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-run-ovn-kubernetes\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-sysctl-d\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.596151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594766 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-sysctl-d\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.594814 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-device-dir\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.595422 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-host\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.595714 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-sys-fs\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:52.595809 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:52.595886 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs podName:8dd28ca5-aeb7-4eb9-b38d-827f82b57d61 nodeName:}" failed. No retries permitted until 2026-07-29 19:16:53.095845522 +0000 UTC m=+2.984152734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs") pod "network-metrics-daemon-tvjjw" (UID: "8dd28ca5-aeb7-4eb9-b38d-827f82b57d61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.596470 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/08faa4de-239e-43a9-a111-f9d490a0710d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.596727 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08faa4de-239e-43a9-a111-f9d490a0710d-system-cni-dir\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.596806 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-cni-netd\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.596847 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e81e9dc9-feaa-4613-ba05-0053b871b648-socket-dir\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.596914 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-modprobe-d\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.596983 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-var-lib-kubelet\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.597242 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5-iptables-alerter-script\") pod \"iptables-alerter-fmtks\" (UID: \"9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5\") " pod="openshift-network-operator/iptables-alerter-fmtks" Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.597327 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08faa4de-239e-43a9-a111-f9d490a0710d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.597350 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-ovnkube-script-lib\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.597455 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-kubelet\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.597469 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-run-netns\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.598476 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.597521 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-sys\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.599377 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.597549 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-sysconfig\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.599377 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.597571 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-kubernetes\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.599377 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.597621 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-run\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.599377 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.597715 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08faa4de-239e-43a9-a111-f9d490a0710d-os-release\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.599377 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.597757 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-host-run-ovn-kubernetes\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.599377 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.597849 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08faa4de-239e-43a9-a111-f9d490a0710d-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.599377 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.597892 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-run-systemd\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.599377 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.597982 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0fb4252c-4795-40b7-8f5e-e1f540f9ec8b-serviceca\") pod \"node-ca-5wg8l\" (UID: \"0fb4252c-4795-40b7-8f5e-e1f540f9ec8b\") " pod="openshift-image-registry/node-ca-5wg8l" Jul 29 19:16:52.599377 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.598068 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9e56c811-fd8f-47a4-a92c-44bd94993dce-konnectivity-ca\") pod \"konnectivity-agent-7s2ld\" (UID: \"9e56c811-fd8f-47a4-a92c-44bd94993dce\") " pod="kube-system/konnectivity-agent-7s2ld" Jul 29 19:16:52.599377 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.598291 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-ovnkube-config\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.599885 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.599694 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-etc-tuned\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.600335 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.600297 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-tmp\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.600737 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.600711 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9e56c811-fd8f-47a4-a92c-44bd94993dce-agent-certs\") pod \"konnectivity-agent-7s2ld\" (UID: \"9e56c811-fd8f-47a4-a92c-44bd94993dce\") " pod="kube-system/konnectivity-agent-7s2ld" Jul 29 19:16:52.602081 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.602057 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-ovn-node-metrics-cert\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.609255 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.609191 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh99n\" (UniqueName: \"kubernetes.io/projected/08faa4de-239e-43a9-a111-f9d490a0710d-kube-api-access-fh99n\") pod \"multus-additional-cni-plugins-n6c27\" (UID: \"08faa4de-239e-43a9-a111-f9d490a0710d\") " pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.610303 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.610244 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntq7p\" (UniqueName: \"kubernetes.io/projected/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-kube-api-access-ntq7p\") pod \"network-metrics-daemon-tvjjw\" (UID: \"8dd28ca5-aeb7-4eb9-b38d-827f82b57d61\") " pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:16:52.610928 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.610906 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb888\" (UniqueName: \"kubernetes.io/projected/05e53a84-6c43-4a87-8e2a-fb5ecaaf8425-kube-api-access-nb888\") pod \"ovnkube-node-dxx86\" (UID: \"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425\") " pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.612130 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.611898 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7zjb\" (UniqueName: \"kubernetes.io/projected/0fb4252c-4795-40b7-8f5e-e1f540f9ec8b-kube-api-access-w7zjb\") pod \"node-ca-5wg8l\" (UID: \"0fb4252c-4795-40b7-8f5e-e1f540f9ec8b\") " pod="openshift-image-registry/node-ca-5wg8l" Jul 29 19:16:52.612923 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.612565 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n75z\" (UniqueName: \"kubernetes.io/projected/15ce9c27-136b-45e9-b574-fdd2c4b4c2c0-kube-api-access-6n75z\") pod \"tuned-tm646\" (UID: \"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0\") " pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.613276 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.613138 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr9mb\" (UniqueName: \"kubernetes.io/projected/e81e9dc9-feaa-4613-ba05-0053b871b648-kube-api-access-pr9mb\") pod \"aws-ebs-csi-driver-node-jm6cb\" (UID: \"e81e9dc9-feaa-4613-ba05-0053b871b648\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.615084 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.614966 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjpxs\" (UniqueName: \"kubernetes.io/projected/9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5-kube-api-access-bjpxs\") pod \"iptables-alerter-fmtks\" (UID: \"9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5\") " pod="openshift-network-operator/iptables-alerter-fmtks" Jul 29 19:16:52.695725 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.695691 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-etc-kubernetes\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.695900 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.695732 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret\") pod \"global-pull-secret-syncer-7plmd\" (UID: \"9521677d-7019-45f6-8e84-472a86d51c00\") " pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:16:52.695900 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.695758 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/24eb0b3d-db69-436a-8e65-009a7a0f0fba-multus-daemon-config\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.695900 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.695793 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-etc-kubernetes\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.695900 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.695828 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24eb0b3d-db69-436a-8e65-009a7a0f0fba-cni-binary-copy\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.695900 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.695854 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-hostroot\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.695900 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:52.695861 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 19:16:52.695900 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.695875 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmsl2\" (UniqueName: \"kubernetes.io/projected/24eb0b3d-db69-436a-8e65-009a7a0f0fba-kube-api-access-fmsl2\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.695906 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dfzm\" (UniqueName: \"kubernetes.io/projected/44e454bf-8721-4247-b10c-9eb4f1d850b1-kube-api-access-5dfzm\") pod \"node-resolver-m4qwh\" (UID: \"44e454bf-8721-4247-b10c-9eb4f1d850b1\") " pod="openshift-dns/node-resolver-m4qwh" Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:52.695932 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret podName:9521677d-7019-45f6-8e84-472a86d51c00 nodeName:}" failed. No retries permitted until 2026-07-29 19:16:53.195916137 +0000 UTC m=+3.084223354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret") pod "global-pull-secret-syncer-7plmd" (UID: "9521677d-7019-45f6-8e84-472a86d51c00") : object "kube-system"/"original-pull-secret" not registered Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.695988 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-multus-cni-dir\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696022 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-var-lib-cni-bin\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696046 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9521677d-7019-45f6-8e84-472a86d51c00-kubelet-config\") pod \"global-pull-secret-syncer-7plmd\" (UID: \"9521677d-7019-45f6-8e84-472a86d51c00\") " pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696078 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7l6\" (UniqueName: \"kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6\") pod \"network-check-target-9gg2k\" (UID: \"ca94bfdc-31fd-44d4-a87a-a507fa3ef39c\") " pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696109 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-var-lib-kubelet\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696135 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44e454bf-8721-4247-b10c-9eb4f1d850b1-tmp-dir\") pod \"node-resolver-m4qwh\" (UID: \"44e454bf-8721-4247-b10c-9eb4f1d850b1\") " pod="openshift-dns/node-resolver-m4qwh" Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696157 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-os-release\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696161 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-hostroot\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696179 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9521677d-7019-45f6-8e84-472a86d51c00-dbus\") pod \"global-pull-secret-syncer-7plmd\" (UID: \"9521677d-7019-45f6-8e84-472a86d51c00\") " pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696205 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-run-multus-certs\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696233 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-multus-socket-dir-parent\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696248 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-run-netns\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44e454bf-8721-4247-b10c-9eb4f1d850b1-hosts-file\") pod \"node-resolver-m4qwh\" (UID: \"44e454bf-8721-4247-b10c-9eb4f1d850b1\") " pod="openshift-dns/node-resolver-m4qwh" Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-system-cni-dir\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.696328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696299 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-run-k8s-cni-cncf-io\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696313 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-var-lib-cni-multus\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696329 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-multus-conf-dir\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696355 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-cnibin\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696390 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44e454bf-8721-4247-b10c-9eb4f1d850b1-hosts-file\") pod \"node-resolver-m4qwh\" (UID: \"44e454bf-8721-4247-b10c-9eb4f1d850b1\") " pod="openshift-dns/node-resolver-m4qwh" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696428 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-cnibin\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696456 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-os-release\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696471 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-system-cni-dir\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696497 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-run-k8s-cni-cncf-io\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696523 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-run-multus-certs\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696310 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/24eb0b3d-db69-436a-8e65-009a7a0f0fba-multus-daemon-config\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696560 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44e454bf-8721-4247-b10c-9eb4f1d850b1-tmp-dir\") pod \"node-resolver-m4qwh\" (UID: \"44e454bf-8721-4247-b10c-9eb4f1d850b1\") " pod="openshift-dns/node-resolver-m4qwh" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696577 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-multus-socket-dir-parent\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696585 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-var-lib-cni-multus\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696633 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9521677d-7019-45f6-8e84-472a86d51c00-dbus\") pod \"global-pull-secret-syncer-7plmd\" (UID: \"9521677d-7019-45f6-8e84-472a86d51c00\") " pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696635 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-run-netns\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696636 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-multus-cni-dir\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696677 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-multus-conf-dir\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.697392 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696697 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-var-lib-cni-bin\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.698237 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696717 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24eb0b3d-db69-436a-8e65-009a7a0f0fba-host-var-lib-kubelet\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.698237 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.696720 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9521677d-7019-45f6-8e84-472a86d51c00-kubelet-config\") pod \"global-pull-secret-syncer-7plmd\" (UID: \"9521677d-7019-45f6-8e84-472a86d51c00\") " pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:16:52.698237 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.697021 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24eb0b3d-db69-436a-8e65-009a7a0f0fba-cni-binary-copy\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.702743 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:52.702584 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 19:16:52.702743 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:52.702609 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 19:16:52.702743 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:52.702622 2574 projected.go:196] Error preparing data for projected volume kube-api-access-xr7l6 for pod openshift-network-diagnostics/network-check-target-9gg2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:16:52.702743 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:52.702686 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6 podName:ca94bfdc-31fd-44d4-a87a-a507fa3ef39c nodeName:}" failed. No retries permitted until 2026-07-29 19:16:53.202668989 +0000 UTC m=+3.090976205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xr7l6" (UniqueName: "kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6") pod "network-check-target-9gg2k" (UID: "ca94bfdc-31fd-44d4-a87a-a507fa3ef39c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:16:52.707262 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.707238 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dfzm\" (UniqueName: \"kubernetes.io/projected/44e454bf-8721-4247-b10c-9eb4f1d850b1-kube-api-access-5dfzm\") pod \"node-resolver-m4qwh\" (UID: \"44e454bf-8721-4247-b10c-9eb4f1d850b1\") " pod="openshift-dns/node-resolver-m4qwh" Jul 29 19:16:52.711386 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.711202 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmsl2\" (UniqueName: \"kubernetes.io/projected/24eb0b3d-db69-436a-8e65-009a7a0f0fba-kube-api-access-fmsl2\") pod \"multus-t6b8t\" (UID: \"24eb0b3d-db69-436a-8e65-009a7a0f0fba\") " pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.789438 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.789400 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fmtks" Jul 29 19:16:52.793437 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.793410 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" Jul 29 19:16:52.800859 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:52.800797 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2cf6d3_b9ba_486e_bbcd_b6207e420ff5.slice/crio-3ddbb553616703f2dcbfb2901cf4058c20d66f085b2f341e5aac25c54d9f35ea WatchSource:0}: Error finding container 3ddbb553616703f2dcbfb2901cf4058c20d66f085b2f341e5aac25c54d9f35ea: Status 404 returned error can't find the container with id 3ddbb553616703f2dcbfb2901cf4058c20d66f085b2f341e5aac25c54d9f35ea Jul 29 19:16:52.803080 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.803056 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tm646" Jul 29 19:16:52.804473 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:52.804448 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81e9dc9_feaa_4613_ba05_0053b871b648.slice/crio-5bba4273f2448271715f979e873497782171a5f7e5021624f211ac5efbf7c5c4 WatchSource:0}: Error finding container 5bba4273f2448271715f979e873497782171a5f7e5021624f211ac5efbf7c5c4: Status 404 returned error can't find the container with id 5bba4273f2448271715f979e873497782171a5f7e5021624f211ac5efbf7c5c4 Jul 29 19:16:52.810148 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.810121 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5wg8l" Jul 29 19:16:52.812308 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:52.812288 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ce9c27_136b_45e9_b574_fdd2c4b4c2c0.slice/crio-d1a254314337c5043bdff7c14a2a24d62eb19f73eb5a3586716a34888d991219 WatchSource:0}: Error finding container d1a254314337c5043bdff7c14a2a24d62eb19f73eb5a3586716a34888d991219: Status 404 returned error can't find the container with id d1a254314337c5043bdff7c14a2a24d62eb19f73eb5a3586716a34888d991219 Jul 29 19:16:52.816683 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.816663 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:16:52.824239 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.824214 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7s2ld" Jul 29 19:16:52.830974 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.830951 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n6c27" Jul 29 19:16:52.839919 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.839900 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m4qwh" Jul 29 19:16:52.846656 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.846634 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t6b8t" Jul 29 19:16:52.996646 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:52.996561 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 19:16:53.098796 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:53.098757 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs\") pod \"network-metrics-daemon-tvjjw\" (UID: \"8dd28ca5-aeb7-4eb9-b38d-827f82b57d61\") " pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:16:53.098971 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:53.098939 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:16:53.099041 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:53.099024 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs podName:8dd28ca5-aeb7-4eb9-b38d-827f82b57d61 nodeName:}" failed. No retries permitted until 2026-07-29 19:16:54.099001186 +0000 UTC m=+3.987308393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs") pod "network-metrics-daemon-tvjjw" (UID: "8dd28ca5-aeb7-4eb9-b38d-827f82b57d61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:16:53.199769 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:53.199737 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret\") pod \"global-pull-secret-syncer-7plmd\" (UID: \"9521677d-7019-45f6-8e84-472a86d51c00\") " pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:16:53.199930 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:53.199908 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 19:16:53.199985 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:53.199974 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret podName:9521677d-7019-45f6-8e84-472a86d51c00 nodeName:}" failed. No retries permitted until 2026-07-29 19:16:54.199958851 +0000 UTC m=+4.088266060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret") pod "global-pull-secret-syncer-7plmd" (UID: "9521677d-7019-45f6-8e84-472a86d51c00") : object "kube-system"/"original-pull-secret" not registered Jul 29 19:16:53.301120 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:53.301042 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7l6\" (UniqueName: \"kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6\") pod \"network-check-target-9gg2k\" (UID: \"ca94bfdc-31fd-44d4-a87a-a507fa3ef39c\") " pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:16:53.301276 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:53.301185 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 19:16:53.301276 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:53.301200 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 19:16:53.301276 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:53.301211 2574 projected.go:196] Error preparing data for projected volume kube-api-access-xr7l6 for pod openshift-network-diagnostics/network-check-target-9gg2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:16:53.301276 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:53.301264 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6 podName:ca94bfdc-31fd-44d4-a87a-a507fa3ef39c nodeName:}" failed. No retries permitted until 2026-07-29 19:16:54.301250676 +0000 UTC m=+4.189557880 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr7l6" (UniqueName: "kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6") pod "network-check-target-9gg2k" (UID: "ca94bfdc-31fd-44d4-a87a-a507fa3ef39c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:16:53.523011 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:53.522960 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 19:11:52 +0000 UTC" deadline="2028-01-04 14:25:26.68169132 +0000 UTC" Jul 29 19:16:53.523011 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:53.523009 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12571h8m33.158686251s" Jul 29 19:16:53.728773 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:53.727994 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:16:53.728773 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:53.728111 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:16:53.728773 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:53.728491 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:16:53.728773 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:53.728599 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:16:53.728773 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:53.728660 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:16:53.728773 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:53.728734 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:16:53.735900 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:53.735837 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tm646" event={"ID":"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0","Type":"ContainerStarted","Data":"d1a254314337c5043bdff7c14a2a24d62eb19f73eb5a3586716a34888d991219"} Jul 29 19:16:53.737584 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:53.737524 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" event={"ID":"e81e9dc9-feaa-4613-ba05-0053b871b648","Type":"ContainerStarted","Data":"5bba4273f2448271715f979e873497782171a5f7e5021624f211ac5efbf7c5c4"} Jul 29 19:16:53.740678 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:53.740496 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fmtks" event={"ID":"9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5","Type":"ContainerStarted","Data":"3ddbb553616703f2dcbfb2901cf4058c20d66f085b2f341e5aac25c54d9f35ea"} Jul 29 19:16:53.959708 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:53.959594 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fb4252c_4795_40b7_8f5e_e1f540f9ec8b.slice/crio-851c300b9f5cd61a1ab29b4830d9fdb4163aed70939e8e093c53b5c47e86c8be WatchSource:0}: Error finding container 851c300b9f5cd61a1ab29b4830d9fdb4163aed70939e8e093c53b5c47e86c8be: Status 404 returned error can't find the container with id 851c300b9f5cd61a1ab29b4830d9fdb4163aed70939e8e093c53b5c47e86c8be Jul 29 19:16:53.969557 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:53.969392 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e56c811_fd8f_47a4_a92c_44bd94993dce.slice/crio-a207be48004500939bef3a44195537a572b2f47a03a031fd2678851a765f88de WatchSource:0}: Error finding container a207be48004500939bef3a44195537a572b2f47a03a031fd2678851a765f88de: Status 404 returned error can't find the container with id a207be48004500939bef3a44195537a572b2f47a03a031fd2678851a765f88de Jul 29 19:16:53.971898 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:53.971881 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24eb0b3d_db69_436a_8e65_009a7a0f0fba.slice/crio-8464657adeaf51162725a9acf65362f1b0daf62d3bcf9d99c4759d7bdc1d73ea WatchSource:0}: Error finding container 8464657adeaf51162725a9acf65362f1b0daf62d3bcf9d99c4759d7bdc1d73ea: Status 404 returned error can't find the container with id 8464657adeaf51162725a9acf65362f1b0daf62d3bcf9d99c4759d7bdc1d73ea Jul 29 19:16:53.973018 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:53.972989 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e53a84_6c43_4a87_8e2a_fb5ecaaf8425.slice/crio-09728f9b72159a9d37984ea53ec9ba7c75618c3408a4ef99fcd2a65a05174fe8 WatchSource:0}: Error finding container 09728f9b72159a9d37984ea53ec9ba7c75618c3408a4ef99fcd2a65a05174fe8: Status 404 returned error can't find the container with id 09728f9b72159a9d37984ea53ec9ba7c75618c3408a4ef99fcd2a65a05174fe8 Jul 29 19:16:53.975597 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:53.975066 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e454bf_8721_4247_b10c_9eb4f1d850b1.slice/crio-64a5129a83da0ee0136042829477c3350e046d8c608a099428e2a801fa74d0e9 WatchSource:0}: Error finding container 64a5129a83da0ee0136042829477c3350e046d8c608a099428e2a801fa74d0e9: Status 404 returned error can't find the container with id 64a5129a83da0ee0136042829477c3350e046d8c608a099428e2a801fa74d0e9 Jul 29 19:16:53.976168 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:16:53.976046 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08faa4de_239e_43a9_a111_f9d490a0710d.slice/crio-9f4baf58899fbabca3f30c4a5c8e2c215ecc888cab776196686da2c2dd265900 WatchSource:0}: Error finding container 9f4baf58899fbabca3f30c4a5c8e2c215ecc888cab776196686da2c2dd265900: Status 404 returned error can't find the container with id 9f4baf58899fbabca3f30c4a5c8e2c215ecc888cab776196686da2c2dd265900 Jul 29 19:16:54.108944 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:54.108910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs\") pod \"network-metrics-daemon-tvjjw\" (UID: \"8dd28ca5-aeb7-4eb9-b38d-827f82b57d61\") " pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:16:54.109077 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:54.109042 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:16:54.109181 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:54.109120 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs podName:8dd28ca5-aeb7-4eb9-b38d-827f82b57d61 nodeName:}" failed. No retries permitted until 2026-07-29 19:16:56.109102006 +0000 UTC m=+5.997409219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs") pod "network-metrics-daemon-tvjjw" (UID: "8dd28ca5-aeb7-4eb9-b38d-827f82b57d61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:16:54.210253 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:54.210216 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret\") pod \"global-pull-secret-syncer-7plmd\" (UID: \"9521677d-7019-45f6-8e84-472a86d51c00\") " pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:16:54.210415 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:54.210370 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 19:16:54.210459 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:54.210442 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret podName:9521677d-7019-45f6-8e84-472a86d51c00 nodeName:}" failed. No retries permitted until 2026-07-29 19:16:56.210422787 +0000 UTC m=+6.098730004 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret") pod "global-pull-secret-syncer-7plmd" (UID: "9521677d-7019-45f6-8e84-472a86d51c00") : object "kube-system"/"original-pull-secret" not registered Jul 29 19:16:54.311598 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:54.311322 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7l6\" (UniqueName: \"kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6\") pod \"network-check-target-9gg2k\" (UID: \"ca94bfdc-31fd-44d4-a87a-a507fa3ef39c\") " pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:16:54.311723 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:54.311695 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 19:16:54.311792 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:54.311739 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 19:16:54.311792 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:54.311754 2574 projected.go:196] Error preparing data for projected volume kube-api-access-xr7l6 for pod openshift-network-diagnostics/network-check-target-9gg2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:16:54.311878 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:54.311821 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6 podName:ca94bfdc-31fd-44d4-a87a-a507fa3ef39c nodeName:}" failed. No retries permitted until 2026-07-29 19:16:56.311801124 +0000 UTC m=+6.200108354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr7l6" (UniqueName: "kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6") pod "network-check-target-9gg2k" (UID: "ca94bfdc-31fd-44d4-a87a-a507fa3ef39c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:16:54.523745 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:54.523657 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 19:11:52 +0000 UTC" deadline="2028-01-28 23:27:46.906183801 +0000 UTC" Jul 29 19:16:54.523745 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:54.523698 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13156h10m52.382490307s" Jul 29 19:16:54.751002 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:54.750966 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal" event={"ID":"63bcc45c5ec23bde54a6545b8958739b","Type":"ContainerStarted","Data":"3549606b6b8a4d16db16835041f14f510d254f7eb48cdc726a48d9576bc47b07"} Jul 29 19:16:54.757858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:54.757823 2574 generic.go:356] "Generic (PLEG): container finished" podID="e26e3999a322700a50986239dc7d13f1" containerID="2b41377a359ba28f23f5b79b2c7a9e26433abb381b39d179703c7bf80adfc116" exitCode=0 Jul 29 19:16:54.758007 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:54.757913 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" event={"ID":"e26e3999a322700a50986239dc7d13f1","Type":"ContainerDied","Data":"2b41377a359ba28f23f5b79b2c7a9e26433abb381b39d179703c7bf80adfc116"} Jul 29 19:16:54.767009 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:54.766846 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6c27" event={"ID":"08faa4de-239e-43a9-a111-f9d490a0710d","Type":"ContainerStarted","Data":"9f4baf58899fbabca3f30c4a5c8e2c215ecc888cab776196686da2c2dd265900"} Jul 29 19:16:54.778751 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:54.778650 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7s2ld" event={"ID":"9e56c811-fd8f-47a4-a92c-44bd94993dce","Type":"ContainerStarted","Data":"a207be48004500939bef3a44195537a572b2f47a03a031fd2678851a765f88de"} Jul 29 19:16:54.789805 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:54.789755 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal" podStartSLOduration=3.789738489 podStartE2EDuration="3.789738489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:16:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:54.766851267 +0000 UTC m=+4.655158496" watchObservedRunningTime="2026-07-29 19:16:54.789738489 +0000 UTC m=+4.678045718" Jul 29 19:16:54.790950 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:54.790923 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t6b8t" event={"ID":"24eb0b3d-db69-436a-8e65-009a7a0f0fba","Type":"ContainerStarted","Data":"8464657adeaf51162725a9acf65362f1b0daf62d3bcf9d99c4759d7bdc1d73ea"} Jul 29 19:16:54.797389 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:54.797339 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5wg8l" event={"ID":"0fb4252c-4795-40b7-8f5e-e1f540f9ec8b","Type":"ContainerStarted","Data":"851c300b9f5cd61a1ab29b4830d9fdb4163aed70939e8e093c53b5c47e86c8be"} Jul 29 19:16:54.803184 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:54.803124 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m4qwh" event={"ID":"44e454bf-8721-4247-b10c-9eb4f1d850b1","Type":"ContainerStarted","Data":"64a5129a83da0ee0136042829477c3350e046d8c608a099428e2a801fa74d0e9"} Jul 29 19:16:54.816119 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:54.815745 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" event={"ID":"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425","Type":"ContainerStarted","Data":"09728f9b72159a9d37984ea53ec9ba7c75618c3408a4ef99fcd2a65a05174fe8"} Jul 29 19:16:55.727992 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:55.727909 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:16:55.728426 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:55.728053 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:16:55.728498 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:55.728438 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:16:55.728572 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:55.728544 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:16:55.728633 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:55.728606 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:16:55.728705 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:55.728680 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:16:55.828834 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:55.828581 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" event={"ID":"e26e3999a322700a50986239dc7d13f1","Type":"ContainerStarted","Data":"b6dbdb42213826ff21f55a820a9504adc644d3418f4d1f376acaa6d2c390a22a"} Jul 29 19:16:55.845450 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:55.845138 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" podStartSLOduration=4.845118762 podStartE2EDuration="4.845118762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:16:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:16:55.844185184 +0000 UTC m=+5.732492412" watchObservedRunningTime="2026-07-29 19:16:55.845118762 +0000 UTC m=+5.733425989" Jul 29 19:16:56.130025 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:56.129397 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs\") pod \"network-metrics-daemon-tvjjw\" (UID: \"8dd28ca5-aeb7-4eb9-b38d-827f82b57d61\") " pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:16:56.130025 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:56.129588 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:16:56.130025 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:56.129649 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs podName:8dd28ca5-aeb7-4eb9-b38d-827f82b57d61 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:00.129630854 +0000 UTC m=+10.017938071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs") pod "network-metrics-daemon-tvjjw" (UID: "8dd28ca5-aeb7-4eb9-b38d-827f82b57d61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:16:56.231095 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:56.230554 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret\") pod \"global-pull-secret-syncer-7plmd\" (UID: \"9521677d-7019-45f6-8e84-472a86d51c00\") " pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:16:56.231095 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:56.230718 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 19:16:56.231095 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:56.230779 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret podName:9521677d-7019-45f6-8e84-472a86d51c00 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:00.230759238 +0000 UTC m=+10.119066449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret") pod "global-pull-secret-syncer-7plmd" (UID: "9521677d-7019-45f6-8e84-472a86d51c00") : object "kube-system"/"original-pull-secret" not registered Jul 29 19:16:56.331834 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:56.331784 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7l6\" (UniqueName: \"kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6\") pod \"network-check-target-9gg2k\" (UID: \"ca94bfdc-31fd-44d4-a87a-a507fa3ef39c\") " pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:16:56.332103 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:56.332039 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 19:16:56.332103 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:56.332066 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 19:16:56.332103 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:56.332078 2574 projected.go:196] Error preparing data for projected volume kube-api-access-xr7l6 for pod openshift-network-diagnostics/network-check-target-9gg2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:16:56.332300 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:56.332142 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6 podName:ca94bfdc-31fd-44d4-a87a-a507fa3ef39c nodeName:}" failed. No retries permitted until 2026-07-29 19:17:00.332123649 +0000 UTC m=+10.220430857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr7l6" (UniqueName: "kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6") pod "network-check-target-9gg2k" (UID: "ca94bfdc-31fd-44d4-a87a-a507fa3ef39c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:16:57.728135 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:57.728097 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:16:57.728135 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:57.728130 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:16:57.728678 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:57.728130 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:16:57.728678 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:57.728234 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:16:57.728678 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:57.728329 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:16:57.728678 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:57.728432 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:16:59.728404 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:59.728354 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:16:59.728404 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:59.728397 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:16:59.728935 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:16:59.728355 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:16:59.728935 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:59.728496 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:16:59.728935 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:59.728614 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:16:59.729085 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:16:59.729033 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:17:00.162808 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:00.162769 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs\") pod \"network-metrics-daemon-tvjjw\" (UID: \"8dd28ca5-aeb7-4eb9-b38d-827f82b57d61\") " pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:00.162991 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:00.162972 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:17:00.163054 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:00.163035 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs podName:8dd28ca5-aeb7-4eb9-b38d-827f82b57d61 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:08.163016611 +0000 UTC m=+18.051323820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs") pod "network-metrics-daemon-tvjjw" (UID: "8dd28ca5-aeb7-4eb9-b38d-827f82b57d61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:17:00.264221 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:00.264118 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret\") pod \"global-pull-secret-syncer-7plmd\" (UID: \"9521677d-7019-45f6-8e84-472a86d51c00\") " pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:00.264388 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:00.264291 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 19:17:00.264388 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:00.264378 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret podName:9521677d-7019-45f6-8e84-472a86d51c00 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:08.264358344 +0000 UTC m=+18.152665551 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret") pod "global-pull-secret-syncer-7plmd" (UID: "9521677d-7019-45f6-8e84-472a86d51c00") : object "kube-system"/"original-pull-secret" not registered Jul 29 19:17:00.365482 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:00.365444 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7l6\" (UniqueName: \"kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6\") pod \"network-check-target-9gg2k\" (UID: \"ca94bfdc-31fd-44d4-a87a-a507fa3ef39c\") " pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:00.365711 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:00.365690 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 19:17:00.365822 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:00.365737 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 19:17:00.365822 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:00.365751 2574 projected.go:196] Error preparing data for projected volume kube-api-access-xr7l6 for pod openshift-network-diagnostics/network-check-target-9gg2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:17:00.365822 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:00.365812 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6 podName:ca94bfdc-31fd-44d4-a87a-a507fa3ef39c nodeName:}" failed. No retries permitted until 2026-07-29 19:17:08.365795769 +0000 UTC m=+18.254102976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr7l6" (UniqueName: "kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6") pod "network-check-target-9gg2k" (UID: "ca94bfdc-31fd-44d4-a87a-a507fa3ef39c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:17:01.728000 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:01.727966 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:01.728000 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:01.727986 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:01.728536 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:01.728088 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:01.728536 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:01.728089 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:17:01.728536 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:01.728169 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:17:01.728536 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:01.728248 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:17:03.728369 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:03.728341 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:03.728755 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:03.728378 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:03.728755 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:03.728337 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:03.728755 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:03.728467 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:17:03.728755 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:03.728552 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:17:03.728755 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:03.728619 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:17:05.727891 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:05.727852 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:05.727891 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:05.727886 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:05.728393 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:05.727888 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:05.728393 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:05.727987 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:17:05.728393 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:05.728059 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:17:05.728393 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:05.728128 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:17:07.728207 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:07.728156 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:07.728691 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:07.728156 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:07.728691 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:07.728295 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:07.728691 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:07.728288 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:17:07.728691 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:07.728384 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:17:07.728691 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:07.728503 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:17:08.224754 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:08.224720 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs\") pod \"network-metrics-daemon-tvjjw\" (UID: \"8dd28ca5-aeb7-4eb9-b38d-827f82b57d61\") " pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:08.224990 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:08.224859 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:17:08.224990 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:08.224913 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs podName:8dd28ca5-aeb7-4eb9-b38d-827f82b57d61 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:24.224899872 +0000 UTC m=+34.113207080 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs") pod "network-metrics-daemon-tvjjw" (UID: "8dd28ca5-aeb7-4eb9-b38d-827f82b57d61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:17:08.325380 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:08.325347 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret\") pod \"global-pull-secret-syncer-7plmd\" (UID: \"9521677d-7019-45f6-8e84-472a86d51c00\") " pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:08.325581 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:08.325525 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 19:17:08.325651 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:08.325596 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret podName:9521677d-7019-45f6-8e84-472a86d51c00 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:24.325576401 +0000 UTC m=+34.213883610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret") pod "global-pull-secret-syncer-7plmd" (UID: "9521677d-7019-45f6-8e84-472a86d51c00") : object "kube-system"/"original-pull-secret" not registered Jul 29 19:17:08.426224 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:08.426188 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7l6\" (UniqueName: \"kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6\") pod \"network-check-target-9gg2k\" (UID: \"ca94bfdc-31fd-44d4-a87a-a507fa3ef39c\") " pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:08.426393 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:08.426328 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 19:17:08.426393 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:08.426347 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 19:17:08.426393 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:08.426358 2574 projected.go:196] Error preparing data for projected volume kube-api-access-xr7l6 for pod openshift-network-diagnostics/network-check-target-9gg2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:17:08.426534 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:08.426413 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6 podName:ca94bfdc-31fd-44d4-a87a-a507fa3ef39c nodeName:}" failed. No retries permitted until 2026-07-29 19:17:24.426399198 +0000 UTC m=+34.314706403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr7l6" (UniqueName: "kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6") pod "network-check-target-9gg2k" (UID: "ca94bfdc-31fd-44d4-a87a-a507fa3ef39c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:17:09.728195 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:09.728155 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:09.728738 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:09.728155 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:09.728738 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:09.728300 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:17:09.728738 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:09.728165 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:09.728738 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:09.728387 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:17:09.728738 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:09.728498 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:17:11.728323 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:11.728048 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:11.728323 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:11.728303 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:11.728777 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:11.728305 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:11.728777 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:11.728400 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:17:11.728777 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:11.728567 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:17:11.728777 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:11.728653 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:17:11.861653 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:11.861605 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tm646" event={"ID":"15ce9c27-136b-45e9-b574-fdd2c4b4c2c0","Type":"ContainerStarted","Data":"ca8b5a35e2fac416b8970dbd77f97786c9ac11875227f67fb40ad7c0e9abaded"} Jul 29 19:17:11.863230 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:11.863163 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" event={"ID":"e81e9dc9-feaa-4613-ba05-0053b871b648","Type":"ContainerStarted","Data":"b727015b7e84a235c82483ac28ce697fb6eb8a930f131d699145fd0472dd1e6d"} Jul 29 19:17:11.864789 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:11.864763 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6c27" event={"ID":"08faa4de-239e-43a9-a111-f9d490a0710d","Type":"ContainerStarted","Data":"669c77a61e56a22cf697deb1e98de8e5a20ca33563ed57df0a29cc7fa60b5c61"} Jul 29 19:17:11.866179 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:11.866157 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7s2ld" event={"ID":"9e56c811-fd8f-47a4-a92c-44bd94993dce","Type":"ContainerStarted","Data":"7e3957d6bcc4128f6fe3010ffc4952b4c81f9cb36803b0dd2e022d3feb45cb8a"} Jul 29 19:17:11.867967 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:11.867938 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t6b8t" event={"ID":"24eb0b3d-db69-436a-8e65-009a7a0f0fba","Type":"ContainerStarted","Data":"8fa6da0d62ee6fb4a730fc101a824df658121742b1af350440d38410ef0619b0"} Jul 29 19:17:11.869467 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:11.869442 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5wg8l" event={"ID":"0fb4252c-4795-40b7-8f5e-e1f540f9ec8b","Type":"ContainerStarted","Data":"153d4e73464d9c2a6a8fa39bc145ddc65280375e638428f232d8fa0367805089"} Jul 29 19:17:11.870941 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:11.870916 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m4qwh" event={"ID":"44e454bf-8721-4247-b10c-9eb4f1d850b1","Type":"ContainerStarted","Data":"bc6732d046a850b7c7481778aa529ac4b6cc54300681bb08d165d157e089d8ff"} Jul 29 19:17:11.879916 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:11.879872 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tm646" podStartSLOduration=3.174394612 podStartE2EDuration="21.879859372s" totalImagesPullingTime="18.70546476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:11.879795097 +0000 UTC m=+21.768102336" watchObservedRunningTime="2026-07-29 19:17:11.879859372 +0000 UTC m=+21.768166600" Jul 29 19:17:11.919460 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:11.919407 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7s2ld" podStartSLOduration=3.372571655 podStartE2EDuration="20.91939105s" totalImagesPullingTime="17.546819395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:11.900163225 +0000 UTC m=+21.788470446" watchObservedRunningTime="2026-07-29 19:17:11.91939105 +0000 UTC m=+21.807698276" Jul 29 19:17:11.919887 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:11.919863 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m4qwh" podStartSLOduration=3.37952852 podStartE2EDuration="20.91985741s" totalImagesPullingTime="17.54032889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:11.919536001 +0000 UTC m=+21.807843209" watchObservedRunningTime="2026-07-29 19:17:11.91985741 +0000 UTC m=+21.808164637" Jul 29 19:17:11.935330 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:11.935292 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5wg8l" podStartSLOduration=4.377863835 podStartE2EDuration="21.935275316s" totalImagesPullingTime="17.557411481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:11.934991919 +0000 UTC m=+21.823299146" watchObservedRunningTime="2026-07-29 19:17:11.935275316 +0000 UTC m=+21.823582583" Jul 29 19:17:11.975664 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:11.975601 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t6b8t" podStartSLOduration=3.389967865 podStartE2EDuration="20.975581689s" totalImagesPullingTime="17.585613824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:11.973711376 +0000 UTC m=+21.862018603" watchObservedRunningTime="2026-07-29 19:17:11.975581689 +0000 UTC m=+21.863888918" Jul 29 19:17:12.874259 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:12.874019 2574 generic.go:356] "Generic (PLEG): container finished" podID="08faa4de-239e-43a9-a111-f9d490a0710d" containerID="669c77a61e56a22cf697deb1e98de8e5a20ca33563ed57df0a29cc7fa60b5c61" exitCode=0 Jul 29 19:17:12.874259 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:12.874109 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6c27" event={"ID":"08faa4de-239e-43a9-a111-f9d490a0710d","Type":"ContainerDied","Data":"669c77a61e56a22cf697deb1e98de8e5a20ca33563ed57df0a29cc7fa60b5c61"} Jul 29 19:17:12.875726 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:12.875697 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fmtks" event={"ID":"9c2cf6d3-b9ba-486e-bbcd-b6207e420ff5","Type":"ContainerStarted","Data":"8deab0b2de18e68a00359bba259d501337451ae0d125a138002723b37ab3cfea"} Jul 29 19:17:12.878308 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:12.878287 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:17:12.878654 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:12.878635 2574 generic.go:356] "Generic (PLEG): container finished" podID="05e53a84-6c43-4a87-8e2a-fb5ecaaf8425" containerID="4e2348fae575ea37c979a58905f0bcd44d30cd84dfada39386a43b646635b2af" exitCode=1 Jul 29 19:17:12.878758 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:12.878737 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" event={"ID":"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425","Type":"ContainerStarted","Data":"d4c1b769ae066d121f3bd36b2d056b6805c2ce2b24abe82df14c60af0d3a3d20"} Jul 29 19:17:12.878823 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:12.878810 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" event={"ID":"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425","Type":"ContainerStarted","Data":"9e091fecbb48145da574233cc6b260440857ee8734dc8d8aab8acba82805ea6d"} Jul 29 19:17:12.878876 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:12.878861 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" event={"ID":"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425","Type":"ContainerStarted","Data":"4c78d3eaa8c7f979d737061a0f94732a24cd90eb13b4301943e180019a18d621"} Jul 29 19:17:12.878934 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:12.878920 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" event={"ID":"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425","Type":"ContainerStarted","Data":"ab603f8b47fcc99dda70de4eb4b1b7aa22ca1c86eecee24739b34412f35e4d19"} Jul 29 19:17:12.878985 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:12.878967 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" event={"ID":"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425","Type":"ContainerDied","Data":"4e2348fae575ea37c979a58905f0bcd44d30cd84dfada39386a43b646635b2af"} Jul 29 19:17:12.879100 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:12.879021 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" event={"ID":"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425","Type":"ContainerStarted","Data":"80f0c316c6f3af531164a5e44ce319a28d7fb3f9d7ee2e921a1ed209870e35ff"} Jul 29 19:17:12.918025 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:12.917973 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fmtks" podStartSLOduration=4.203126881 podStartE2EDuration="22.917957171s" totalImagesPullingTime="18.71483029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:12.917568239 +0000 UTC m=+22.805875465" watchObservedRunningTime="2026-07-29 19:17:12.917957171 +0000 UTC m=+22.806264397" Jul 29 19:17:13.093735 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:13.093706 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 19:17:13.335575 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:13.335537 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7s2ld" Jul 29 19:17:13.336192 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:13.336172 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7s2ld" Jul 29 19:17:13.537565 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:13.537428 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T19:17:13.093725252Z","UUID":"58166ae1-44f7-43de-ba0a-c7ad1b62a7a7","Handler":null,"Name":"","Endpoint":""} Jul 29 19:17:13.539014 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:13.538993 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 19:17:13.539155 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:13.539040 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 19:17:13.728247 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:13.727777 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:13.728247 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:13.727777 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:13.728247 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:13.727814 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:13.728247 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:13.727912 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:17:13.728247 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:13.728042 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:17:13.728247 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:13.728136 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:17:13.883971 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:13.883921 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" event={"ID":"e81e9dc9-feaa-4613-ba05-0053b871b648","Type":"ContainerStarted","Data":"c4960f58f97c0cc9c72783c6ff0a080fbd88f251eb64b835bbbe00482da8da7f"} Jul 29 19:17:13.884447 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:13.884424 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7s2ld" Jul 29 19:17:13.884902 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:13.884879 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7s2ld" Jul 29 19:17:14.889038 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:14.888991 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" event={"ID":"e81e9dc9-feaa-4613-ba05-0053b871b648","Type":"ContainerStarted","Data":"c7c10cab2ab5e66345ed44c4ce4ae57bc02104974552110d0857e6560e670475"} Jul 29 19:17:14.892300 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:14.892276 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:17:14.892738 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:14.892716 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" event={"ID":"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425","Type":"ContainerStarted","Data":"eb4604b2c8ea1b89318cef348bd098227c7bbae6cc5aee9bbfb29ba5b9f51faf"} Jul 29 19:17:14.916956 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:14.916911 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm6cb" podStartSLOduration=3.915558209 podStartE2EDuration="24.916896657s" totalImagesPullingTime="21.001338448s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:16:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:14.916800802 +0000 UTC m=+24.805108031" watchObservedRunningTime="2026-07-29 19:17:14.916896657 +0000 UTC m=+24.805203884" Jul 29 19:17:15.727991 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:15.727802 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:15.728215 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:15.727802 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:15.728215 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:15.728100 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:17:15.728215 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:15.727803 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:15.728215 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:15.728176 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:17:15.728392 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:15.728238 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:17:17.727953 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:17.727778 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:17.728648 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:17.727822 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:17.728648 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:17.728021 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:17:17.728648 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:17.727822 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:17.728648 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:17.728097 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:17:17.728648 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:17.728194 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:17:17.901487 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:17.901449 2574 generic.go:356] "Generic (PLEG): container finished" podID="08faa4de-239e-43a9-a111-f9d490a0710d" containerID="0b3abe27d4355c00f68439fa9b3eccb14dfaa36b15a18c2637acdb8a14e78cb9" exitCode=0 Jul 29 19:17:17.901701 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:17.901547 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6c27" event={"ID":"08faa4de-239e-43a9-a111-f9d490a0710d","Type":"ContainerDied","Data":"0b3abe27d4355c00f68439fa9b3eccb14dfaa36b15a18c2637acdb8a14e78cb9"} Jul 29 19:17:17.904984 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:17.904955 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:17:17.905364 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:17.905340 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" event={"ID":"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425","Type":"ContainerStarted","Data":"07966edb62998615cfd657ab093f2404683962aef84afd18f28d6db974374201"} Jul 29 19:17:17.905711 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:17.905689 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:17:17.905805 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:17.905752 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:17:17.905805 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:17.905804 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:17:17.905944 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:17.905884 2574 scope.go:117] "RemoveContainer" containerID="4e2348fae575ea37c979a58905f0bcd44d30cd84dfada39386a43b646635b2af" Jul 29 19:17:17.921455 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:17.921434 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:17:17.921581 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:17.921570 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:17:18.910000 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:18.909963 2574 generic.go:356] "Generic (PLEG): container finished" podID="08faa4de-239e-43a9-a111-f9d490a0710d" containerID="e1ffb01992f5629359db076167d96db4e27c494552b59040732dc7db1a8f2453" exitCode=0 Jul 29 19:17:18.910465 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:18.910052 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6c27" event={"ID":"08faa4de-239e-43a9-a111-f9d490a0710d","Type":"ContainerDied","Data":"e1ffb01992f5629359db076167d96db4e27c494552b59040732dc7db1a8f2453"} Jul 29 19:17:18.913843 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:18.913826 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:17:18.914180 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:18.914159 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" event={"ID":"05e53a84-6c43-4a87-8e2a-fb5ecaaf8425","Type":"ContainerStarted","Data":"5cbbd66d9a879188bedef2a0686014ccacf594d81dc48101536d677af29d1ec1"} Jul 29 19:17:18.960692 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:18.960628 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" podStartSLOduration=10.104255963 podStartE2EDuration="27.960607074s" totalImagesPullingTime="17.856351111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:18.959977043 +0000 UTC m=+28.848284285" watchObservedRunningTime="2026-07-29 19:17:18.960607074 +0000 UTC m=+28.848914303" Jul 29 19:17:19.202111 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:19.202036 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9gg2k"] Jul 29 19:17:19.202267 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:19.202174 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:19.202314 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:19.202263 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:17:19.204867 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:19.204836 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tvjjw"] Jul 29 19:17:19.204989 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:19.204932 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:19.205039 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:19.205020 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:17:19.208069 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:19.208037 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7plmd"] Jul 29 19:17:19.208177 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:19.208127 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:19.208222 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:19.208203 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:17:19.918448 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:19.918418 2574 generic.go:356] "Generic (PLEG): container finished" podID="08faa4de-239e-43a9-a111-f9d490a0710d" containerID="3223c7a3ecea3a6ab74ce26b6de5845e70ee48e3c44b58196f1bc8599d6de618" exitCode=0 Jul 29 19:17:19.918922 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:19.918519 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6c27" event={"ID":"08faa4de-239e-43a9-a111-f9d490a0710d","Type":"ContainerDied","Data":"3223c7a3ecea3a6ab74ce26b6de5845e70ee48e3c44b58196f1bc8599d6de618"} Jul 29 19:17:20.729426 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:20.729400 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:20.729426 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:20.729428 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:20.729696 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:20.729495 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:20.729696 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:20.729592 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:17:20.729890 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:20.729862 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:17:20.730026 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:20.729913 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:17:22.728074 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:22.727797 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:22.728607 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:22.727804 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:22.728607 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:22.728133 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9gg2k" podUID="ca94bfdc-31fd-44d4-a87a-a507fa3ef39c" Jul 29 19:17:22.728607 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:22.727864 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:22.728607 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:22.728271 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7plmd" podUID="9521677d-7019-45f6-8e84-472a86d51c00" Jul 29 19:17:22.728607 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:22.728364 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tvjjw" podUID="8dd28ca5-aeb7-4eb9-b38d-827f82b57d61" Jul 29 19:17:24.243648 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.243612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs\") pod \"network-metrics-daemon-tvjjw\" (UID: \"8dd28ca5-aeb7-4eb9-b38d-827f82b57d61\") " pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:24.244021 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:24.243730 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:17:24.244021 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:24.243785 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs podName:8dd28ca5-aeb7-4eb9-b38d-827f82b57d61 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:56.243769705 +0000 UTC m=+66.132076914 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs") pod "network-metrics-daemon-tvjjw" (UID: "8dd28ca5-aeb7-4eb9-b38d-827f82b57d61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 19:17:24.344551 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.344501 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret\") pod \"global-pull-secret-syncer-7plmd\" (UID: \"9521677d-7019-45f6-8e84-472a86d51c00\") " pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:24.344701 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:24.344642 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 19:17:24.344701 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:24.344698 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret podName:9521677d-7019-45f6-8e84-472a86d51c00 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:56.344684905 +0000 UTC m=+66.232992109 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret") pod "global-pull-secret-syncer-7plmd" (UID: "9521677d-7019-45f6-8e84-472a86d51c00") : object "kube-system"/"original-pull-secret" not registered Jul 29 19:17:24.444947 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.444919 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7l6\" (UniqueName: \"kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6\") pod \"network-check-target-9gg2k\" (UID: \"ca94bfdc-31fd-44d4-a87a-a507fa3ef39c\") " pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:24.445087 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:24.445067 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 19:17:24.445087 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:24.445083 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 19:17:24.445156 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:24.445092 2574 projected.go:196] Error preparing data for projected volume kube-api-access-xr7l6 for pod openshift-network-diagnostics/network-check-target-9gg2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:17:24.445156 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:24.445140 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6 podName:ca94bfdc-31fd-44d4-a87a-a507fa3ef39c nodeName:}" failed. No retries permitted until 2026-07-29 19:17:56.445125085 +0000 UTC m=+66.333432289 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr7l6" (UniqueName: "kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6") pod "network-check-target-9gg2k" (UID: "ca94bfdc-31fd-44d4-a87a-a507fa3ef39c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 19:17:24.477524 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.477487 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeReady" Jul 29 19:17:24.477708 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.477592 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 19:17:24.510824 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.510795 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cfcf6c44b-wkzcc"] Jul 29 19:17:24.531212 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.531190 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cfcf6c44b-wkzcc"] Jul 29 19:17:24.531321 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.531222 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lzdtw"] Jul 29 19:17:24.531538 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.531332 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.533272 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.533249 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 19:17:24.533400 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.533383 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 19:17:24.533465 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.533251 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 19:17:24.533465 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.533449 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xs7xs\"" Jul 29 19:17:24.545601 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.543726 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 19:17:24.549149 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.549127 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w9tlj"] Jul 29 19:17:24.549250 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.549146 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:24.551058 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.551036 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 19:17:24.551157 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.551071 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 19:17:24.551157 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.551126 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hhdrq\"" Jul 29 19:17:24.571222 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.571204 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w9tlj"] Jul 29 19:17:24.571315 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.571230 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lzdtw"] Jul 29 19:17:24.571375 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.571317 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w9tlj" Jul 29 19:17:24.573292 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.573260 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2xxt4\"" Jul 29 19:17:24.573378 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.573264 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 19:17:24.573378 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.573304 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 19:17:24.573378 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.573370 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 19:17:24.646016 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.645985 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b46bb66d-8a39-4f0a-9758-25fc8b85804a-config-volume\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:24.646096 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.646030 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a108a15f-f888-4215-8577-c0e957166d20-registry-certificates\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.646096 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.646057 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-bound-sa-token\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.646096 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.646078 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8csb\" (UniqueName: \"kubernetes.io/projected/b46bb66d-8a39-4f0a-9758-25fc8b85804a-kube-api-access-m8csb\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:24.646211 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.646149 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:24.646211 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.646175 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a108a15f-f888-4215-8577-c0e957166d20-trusted-ca\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.646211 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.646192 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a108a15f-f888-4215-8577-c0e957166d20-installation-pull-secrets\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.646308 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.646254 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.646308 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.646277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b46bb66d-8a39-4f0a-9758-25fc8b85804a-tmp-dir\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:24.646378 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.646361 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a108a15f-f888-4215-8577-c0e957166d20-ca-trust-extracted\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.646412 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.646378 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bpmq\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-kube-api-access-6bpmq\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.646448 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.646414 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a108a15f-f888-4215-8577-c0e957166d20-image-registry-private-configuration\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.727649 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.727616 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:24.727765 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.727623 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:24.727826 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.727804 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:24.729791 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.729769 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 19:17:24.729894 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.729803 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b2qz7\"" Jul 29 19:17:24.729894 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.729848 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qxkk6\"" Jul 29 19:17:24.729894 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.729808 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 19:17:24.730064 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.729987 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 19:17:24.730209 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.730191 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 19:17:24.746816 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.746793 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a108a15f-f888-4215-8577-c0e957166d20-ca-trust-extracted\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.746905 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.746827 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bpmq\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-kube-api-access-6bpmq\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.746978 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.746958 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a108a15f-f888-4215-8577-c0e957166d20-image-registry-private-configuration\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.747035 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.747007 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b46bb66d-8a39-4f0a-9758-25fc8b85804a-config-volume\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:24.747035 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.747032 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a108a15f-f888-4215-8577-c0e957166d20-registry-certificates\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.747134 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.747053 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-bound-sa-token\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.747134 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.747070 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8csb\" (UniqueName: \"kubernetes.io/projected/b46bb66d-8a39-4f0a-9758-25fc8b85804a-kube-api-access-m8csb\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:24.747134 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.747111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71ad3104-e1e8-44a1-91c2-7b877e8f66c1-cert\") pod \"ingress-canary-w9tlj\" (UID: \"71ad3104-e1e8-44a1-91c2-7b877e8f66c1\") " pod="openshift-ingress-canary/ingress-canary-w9tlj" Jul 29 19:17:24.747134 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.747127 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a108a15f-f888-4215-8577-c0e957166d20-ca-trust-extracted\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.747321 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.747155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:24.747321 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.747182 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2p79\" (UniqueName: \"kubernetes.io/projected/71ad3104-e1e8-44a1-91c2-7b877e8f66c1-kube-api-access-g2p79\") pod \"ingress-canary-w9tlj\" (UID: \"71ad3104-e1e8-44a1-91c2-7b877e8f66c1\") " pod="openshift-ingress-canary/ingress-canary-w9tlj" Jul 29 19:17:24.747321 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.747213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a108a15f-f888-4215-8577-c0e957166d20-trusted-ca\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.747321 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.747235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a108a15f-f888-4215-8577-c0e957166d20-installation-pull-secrets\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.747321 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:24.747264 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 19:17:24.747321 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.747267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.747618 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:24.747330 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls podName:b46bb66d-8a39-4f0a-9758-25fc8b85804a nodeName:}" failed. No retries permitted until 2026-07-29 19:17:25.247310926 +0000 UTC m=+35.135618134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls") pod "dns-default-lzdtw" (UID: "b46bb66d-8a39-4f0a-9758-25fc8b85804a") : secret "dns-default-metrics-tls" not found Jul 29 19:17:24.747618 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:24.747340 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 19:17:24.747618 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:24.747352 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cfcf6c44b-wkzcc: secret "image-registry-tls" not found Jul 29 19:17:24.747618 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.747362 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b46bb66d-8a39-4f0a-9758-25fc8b85804a-tmp-dir\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:24.747618 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:24.747395 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls podName:a108a15f-f888-4215-8577-c0e957166d20 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:25.247379528 +0000 UTC m=+35.135686756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls") pod "image-registry-6cfcf6c44b-wkzcc" (UID: "a108a15f-f888-4215-8577-c0e957166d20") : secret "image-registry-tls" not found Jul 29 19:17:24.747827 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.747662 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b46bb66d-8a39-4f0a-9758-25fc8b85804a-tmp-dir\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:24.747827 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.747662 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a108a15f-f888-4215-8577-c0e957166d20-registry-certificates\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.747827 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.747738 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b46bb66d-8a39-4f0a-9758-25fc8b85804a-config-volume\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:24.748146 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.748127 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a108a15f-f888-4215-8577-c0e957166d20-trusted-ca\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.750964 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.750945 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a108a15f-f888-4215-8577-c0e957166d20-installation-pull-secrets\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.750964 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.750956 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a108a15f-f888-4215-8577-c0e957166d20-image-registry-private-configuration\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.754868 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.754847 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-bound-sa-token\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.755024 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.755006 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8csb\" (UniqueName: \"kubernetes.io/projected/b46bb66d-8a39-4f0a-9758-25fc8b85804a-kube-api-access-m8csb\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:24.755134 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.755118 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bpmq\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-kube-api-access-6bpmq\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:24.847756 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.847732 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71ad3104-e1e8-44a1-91c2-7b877e8f66c1-cert\") pod \"ingress-canary-w9tlj\" (UID: \"71ad3104-e1e8-44a1-91c2-7b877e8f66c1\") " pod="openshift-ingress-canary/ingress-canary-w9tlj" Jul 29 19:17:24.847864 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.847785 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2p79\" (UniqueName: \"kubernetes.io/projected/71ad3104-e1e8-44a1-91c2-7b877e8f66c1-kube-api-access-g2p79\") pod \"ingress-canary-w9tlj\" (UID: \"71ad3104-e1e8-44a1-91c2-7b877e8f66c1\") " pod="openshift-ingress-canary/ingress-canary-w9tlj" Jul 29 19:17:24.849925 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.849903 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71ad3104-e1e8-44a1-91c2-7b877e8f66c1-cert\") pod \"ingress-canary-w9tlj\" (UID: \"71ad3104-e1e8-44a1-91c2-7b877e8f66c1\") " pod="openshift-ingress-canary/ingress-canary-w9tlj" Jul 29 19:17:24.856163 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.856145 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2p79\" (UniqueName: \"kubernetes.io/projected/71ad3104-e1e8-44a1-91c2-7b877e8f66c1-kube-api-access-g2p79\") pod \"ingress-canary-w9tlj\" (UID: \"71ad3104-e1e8-44a1-91c2-7b877e8f66c1\") " pod="openshift-ingress-canary/ingress-canary-w9tlj" Jul 29 19:17:24.882227 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.882206 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w9tlj" Jul 29 19:17:24.934074 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.934036 2574 generic.go:356] "Generic (PLEG): container finished" podID="08faa4de-239e-43a9-a111-f9d490a0710d" containerID="251478c604dacacdc25c84447809ac8637738aebeca3ad9e73803bb4ce9b85ce" exitCode=0 Jul 29 19:17:24.934168 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:24.934103 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6c27" event={"ID":"08faa4de-239e-43a9-a111-f9d490a0710d","Type":"ContainerDied","Data":"251478c604dacacdc25c84447809ac8637738aebeca3ad9e73803bb4ce9b85ce"} Jul 29 19:17:25.076045 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:25.075829 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w9tlj"] Jul 29 19:17:25.079493 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:17:25.079471 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ad3104_e1e8_44a1_91c2_7b877e8f66c1.slice/crio-60840c6f8dee0a4d99eb9628bf57ede2973de6d6134f6b97cdb651a11b56f985 WatchSource:0}: Error finding container 60840c6f8dee0a4d99eb9628bf57ede2973de6d6134f6b97cdb651a11b56f985: Status 404 returned error can't find the container with id 60840c6f8dee0a4d99eb9628bf57ede2973de6d6134f6b97cdb651a11b56f985 Jul 29 19:17:25.250746 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:25.250636 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:25.251292 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:25.250795 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 19:17:25.251292 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:25.250813 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cfcf6c44b-wkzcc: secret "image-registry-tls" not found Jul 29 19:17:25.251292 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:25.250806 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:25.251292 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:25.250866 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls podName:a108a15f-f888-4215-8577-c0e957166d20 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:26.250845837 +0000 UTC m=+36.139153042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls") pod "image-registry-6cfcf6c44b-wkzcc" (UID: "a108a15f-f888-4215-8577-c0e957166d20") : secret "image-registry-tls" not found Jul 29 19:17:25.251292 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:25.250872 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 19:17:25.251292 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:25.250910 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls podName:b46bb66d-8a39-4f0a-9758-25fc8b85804a nodeName:}" failed. No retries permitted until 2026-07-29 19:17:26.250899806 +0000 UTC m=+36.139207011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls") pod "dns-default-lzdtw" (UID: "b46bb66d-8a39-4f0a-9758-25fc8b85804a") : secret "dns-default-metrics-tls" not found Jul 29 19:17:25.940106 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:25.940068 2574 generic.go:356] "Generic (PLEG): container finished" podID="08faa4de-239e-43a9-a111-f9d490a0710d" containerID="d4acbd379200b24b4e4df526a47d453d3499cd2350cb8d7a1ceaa64f15d45da0" exitCode=0 Jul 29 19:17:25.940295 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:25.940153 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6c27" event={"ID":"08faa4de-239e-43a9-a111-f9d490a0710d","Type":"ContainerDied","Data":"d4acbd379200b24b4e4df526a47d453d3499cd2350cb8d7a1ceaa64f15d45da0"} Jul 29 19:17:25.941666 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:25.941636 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w9tlj" event={"ID":"71ad3104-e1e8-44a1-91c2-7b877e8f66c1","Type":"ContainerStarted","Data":"60840c6f8dee0a4d99eb9628bf57ede2973de6d6134f6b97cdb651a11b56f985"} Jul 29 19:17:26.258705 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:26.258621 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:26.258705 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:26.258661 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:26.259220 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:26.258787 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 19:17:26.259220 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:26.258789 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 19:17:26.259220 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:26.258860 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls podName:b46bb66d-8a39-4f0a-9758-25fc8b85804a nodeName:}" failed. No retries permitted until 2026-07-29 19:17:28.258842515 +0000 UTC m=+38.147149750 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls") pod "dns-default-lzdtw" (UID: "b46bb66d-8a39-4f0a-9758-25fc8b85804a") : secret "dns-default-metrics-tls" not found Jul 29 19:17:26.259220 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:26.258800 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cfcf6c44b-wkzcc: secret "image-registry-tls" not found Jul 29 19:17:26.259220 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:26.258942 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls podName:a108a15f-f888-4215-8577-c0e957166d20 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:28.258926287 +0000 UTC m=+38.147233492 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls") pod "image-registry-6cfcf6c44b-wkzcc" (UID: "a108a15f-f888-4215-8577-c0e957166d20") : secret "image-registry-tls" not found Jul 29 19:17:26.949391 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:26.949360 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6c27" event={"ID":"08faa4de-239e-43a9-a111-f9d490a0710d","Type":"ContainerStarted","Data":"2db37cbfed05d75c72fcf8f3257605c5e97328f00dcbf829037f999bafa8efd1"} Jul 29 19:17:26.971385 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:26.971338 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n6c27" podStartSLOduration=8.26328172 podStartE2EDuration="35.971318497s" totalImagesPullingTime="27.708036777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:16:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:26.970045863 +0000 UTC m=+36.858353127" watchObservedRunningTime="2026-07-29 19:17:26.971318497 +0000 UTC m=+36.859625926" Jul 29 19:17:27.123784 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:27.123739 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:27.215851 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:27.215764 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:27.953191 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:27.952968 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w9tlj" event={"ID":"71ad3104-e1e8-44a1-91c2-7b877e8f66c1","Type":"ContainerStarted","Data":"d945dcbde1ad34a62a476789db161cb21e1283b32a1499b258655c2e1a51ab95"} Jul 29 19:17:28.277723 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:28.277694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:28.277723 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:28.277729 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:28.277945 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:28.277817 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 19:17:28.277945 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:28.277829 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cfcf6c44b-wkzcc: secret "image-registry-tls" not found Jul 29 19:17:28.277945 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:28.277835 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 19:17:28.277945 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:28.277873 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls podName:a108a15f-f888-4215-8577-c0e957166d20 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:32.27786106 +0000 UTC m=+42.166168265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls") pod "image-registry-6cfcf6c44b-wkzcc" (UID: "a108a15f-f888-4215-8577-c0e957166d20") : secret "image-registry-tls" not found Jul 29 19:17:28.277945 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:28.277885 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls podName:b46bb66d-8a39-4f0a-9758-25fc8b85804a nodeName:}" failed. No retries permitted until 2026-07-29 19:17:32.277879691 +0000 UTC m=+42.166186897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls") pod "dns-default-lzdtw" (UID: "b46bb66d-8a39-4f0a-9758-25fc8b85804a") : secret "dns-default-metrics-tls" not found Jul 29 19:17:28.971088 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:28.971043 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w9tlj" podStartSLOduration=2.232604213 podStartE2EDuration="4.971028825s" totalImagesPullingTime="2.738424612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:28.970128365 +0000 UTC m=+38.858435591" watchObservedRunningTime="2026-07-29 19:17:28.971028825 +0000 UTC m=+38.859336052" Jul 29 19:17:29.731092 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:29.731061 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:29.788892 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:29.788856 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:32.306733 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:32.306686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:32.306733 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:32.306734 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:32.307191 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:32.306833 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 19:17:32.307191 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:32.306838 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 19:17:32.307191 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:32.306908 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls podName:b46bb66d-8a39-4f0a-9758-25fc8b85804a nodeName:}" failed. No retries permitted until 2026-07-29 19:17:40.306891056 +0000 UTC m=+50.195198261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls") pod "dns-default-lzdtw" (UID: "b46bb66d-8a39-4f0a-9758-25fc8b85804a") : secret "dns-default-metrics-tls" not found Jul 29 19:17:32.307191 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:32.306844 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cfcf6c44b-wkzcc: secret "image-registry-tls" not found Jul 29 19:17:32.307191 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:32.306974 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls podName:a108a15f-f888-4215-8577-c0e957166d20 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:40.306962161 +0000 UTC m=+50.195269367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls") pod "image-registry-6cfcf6c44b-wkzcc" (UID: "a108a15f-f888-4215-8577-c0e957166d20") : secret "image-registry-tls" not found Jul 29 19:17:34.073552 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:34.073499 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:34.174525 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:34.174453 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:34.843966 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:34.843892 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:34.943964 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:34.943930 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:35.045471 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:35.045438 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:35.694835 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:35.694805 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:35.796573 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:35.796538 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:36.905208 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:36.905178 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb"] Jul 29 19:17:36.946712 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:36.946682 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb"] Jul 29 19:17:36.946860 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:36.946772 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:17:36.949066 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:36.949039 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 19:17:36.949303 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:36.949275 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 19:17:36.949447 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:36.949431 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fw749\"" Jul 29 19:17:36.950285 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:36.950263 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 29 19:17:36.950396 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:36.950282 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 29 19:17:37.008309 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.008285 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sx56s"] Jul 29 19:17:37.030630 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.030609 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh"] Jul 29 19:17:37.030759 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.030740 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sx56s" Jul 29 19:17:37.032601 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.032566 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 29 19:17:37.032719 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.032600 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 29 19:17:37.032719 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.032614 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-znb2b\"" Jul 29 19:17:37.042043 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.042020 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-q7tkb\" (UID: \"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:17:37.042142 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.042071 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rx4c\" (UniqueName: \"kubernetes.io/projected/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-kube-api-access-5rx4c\") pod \"cluster-monitoring-operator-548b489cb8-q7tkb\" (UID: \"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:17:37.042207 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.042149 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x5b8\" (UniqueName: \"kubernetes.io/projected/33871ba5-4d43-4229-a3f6-895af4883834-kube-api-access-8x5b8\") pod \"volume-data-source-validator-549c6d54cf-sx56s\" (UID: \"33871ba5-4d43-4229-a3f6-895af4883834\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sx56s" Jul 29 19:17:37.042261 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.042213 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-q7tkb\" (UID: \"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:17:37.052138 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.052120 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-q5gv2"] Jul 29 19:17:37.052255 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.052237 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" Jul 29 19:17:37.055267 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.055248 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 29 19:17:37.055743 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.055728 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-q9wcx\"" Jul 29 19:17:37.056123 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.056102 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 29 19:17:37.056588 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.056562 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 29 19:17:37.076216 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.076193 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl"] Jul 29 19:17:37.076316 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.076303 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:37.079606 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.079588 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 29 19:17:37.079768 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.079749 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 29 19:17:37.079900 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.079882 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5q89x\"" Jul 29 19:17:37.080054 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.080043 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 29 19:17:37.090027 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.089989 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 29 19:17:37.099132 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.099113 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 29 19:17:37.100304 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.100280 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7bb4465977-m9lgt"] Jul 29 19:17:37.101933 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.100742 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl" Jul 29 19:17:37.107140 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.107112 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 29 19:17:37.107244 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.107112 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 29 19:17:37.107423 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.107126 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 29 19:17:37.107423 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.107126 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ttgdb\"" Jul 29 19:17:37.107557 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.107530 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 29 19:17:37.116408 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.116389 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sx56s"] Jul 29 19:17:37.116499 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.116415 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl"] Jul 29 19:17:37.116499 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.116430 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh"] Jul 29 19:17:37.116499 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.116452 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-q5gv2"] Jul 29 19:17:37.116499 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.116469 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bb4465977-m9lgt"] Jul 29 19:17:37.116640 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.116502 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:37.118316 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.118294 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kgtcm\"" Jul 29 19:17:37.118423 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.118315 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 29 19:17:37.118423 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.118331 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 29 19:17:37.118423 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.118407 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 29 19:17:37.118581 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.118562 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 29 19:17:37.118651 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.118636 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 29 19:17:37.118709 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.118702 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 29 19:17:37.127873 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.127857 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v"] Jul 29 19:17:37.142899 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.142875 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f708385-526b-408f-98fe-03b81ef5fb6b-config\") pod \"console-operator-584dcb6b54-q5gv2\" (UID: \"4f708385-526b-408f-98fe-03b81ef5fb6b\") " pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:37.143002 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.142919 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:37.143002 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.142947 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:37.143132 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.143016 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-default-certificate\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:37.143132 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.143058 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-q7tkb\" (UID: \"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:17:37.143132 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.143082 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-stats-auth\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:37.143132 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.143120 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43a9ff3e-13e7-4098-b729-711de6048162-config\") pod \"service-ca-operator-5d6c75f84f-48ltl\" (UID: \"43a9ff3e-13e7-4098-b729-711de6048162\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl" Jul 29 19:17:37.143332 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.143144 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f708385-526b-408f-98fe-03b81ef5fb6b-serving-cert\") pod \"console-operator-584dcb6b54-q5gv2\" (UID: \"4f708385-526b-408f-98fe-03b81ef5fb6b\") " pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:37.143332 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.143165 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f708385-526b-408f-98fe-03b81ef5fb6b-trusted-ca\") pod \"console-operator-584dcb6b54-q5gv2\" (UID: \"4f708385-526b-408f-98fe-03b81ef5fb6b\") " pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:37.143332 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.143187 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m5h2\" (UniqueName: \"kubernetes.io/projected/4f708385-526b-408f-98fe-03b81ef5fb6b-kube-api-access-8m5h2\") pod \"console-operator-584dcb6b54-q5gv2\" (UID: \"4f708385-526b-408f-98fe-03b81ef5fb6b\") " pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:37.143332 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.143213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-q7tkb\" (UID: \"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:17:37.143332 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.143255 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rx4c\" (UniqueName: \"kubernetes.io/projected/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-kube-api-access-5rx4c\") pod \"cluster-monitoring-operator-548b489cb8-q7tkb\" (UID: \"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:17:37.143332 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.143278 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fvtq\" (UniqueName: \"kubernetes.io/projected/43a9ff3e-13e7-4098-b729-711de6048162-kube-api-access-4fvtq\") pod \"service-ca-operator-5d6c75f84f-48ltl\" (UID: \"43a9ff3e-13e7-4098-b729-711de6048162\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl" Jul 29 19:17:37.143332 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.143320 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6fwh\" (UID: \"9a1fc677-c956-43c1-86b9-6db625fed39b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" Jul 29 19:17:37.143696 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.143347 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x5b8\" (UniqueName: \"kubernetes.io/projected/33871ba5-4d43-4229-a3f6-895af4883834-kube-api-access-8x5b8\") pod \"volume-data-source-validator-549c6d54cf-sx56s\" (UID: \"33871ba5-4d43-4229-a3f6-895af4883834\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sx56s" Jul 29 19:17:37.143696 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.143372 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znrp6\" (UniqueName: \"kubernetes.io/projected/9a1fc677-c956-43c1-86b9-6db625fed39b-kube-api-access-znrp6\") pod \"cluster-samples-operator-6748489656-m6fwh\" (UID: \"9a1fc677-c956-43c1-86b9-6db625fed39b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" Jul 29 19:17:37.143696 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.143395 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43a9ff3e-13e7-4098-b729-711de6048162-serving-cert\") pod \"service-ca-operator-5d6c75f84f-48ltl\" (UID: \"43a9ff3e-13e7-4098-b729-711de6048162\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl" Jul 29 19:17:37.143696 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.143435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7shrk\" (UniqueName: \"kubernetes.io/projected/c6ca279a-a264-44bc-b405-6ab87672b286-kube-api-access-7shrk\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:37.143696 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:37.143612 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 19:17:37.143696 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:37.143670 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls podName:a7ee0f3b-4ae1-4005-a5ae-cca1527207aa nodeName:}" failed. No retries permitted until 2026-07-29 19:17:37.643654031 +0000 UTC m=+47.531961237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-q7tkb" (UID: "a7ee0f3b-4ae1-4005-a5ae-cca1527207aa") : secret "cluster-monitoring-operator-tls" not found Jul 29 19:17:37.143997 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.143936 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-q7tkb\" (UID: \"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:17:37.148614 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.148596 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-dtrcq"] Jul 29 19:17:37.148713 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.148697 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v" Jul 29 19:17:37.150374 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.150359 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 29 19:17:37.150581 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.150555 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 29 19:17:37.150692 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.150667 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 29 19:17:37.150777 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.150705 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 29 19:17:37.150831 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.150821 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2wbv4\"" Jul 29 19:17:37.157267 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.157184 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rx4c\" (UniqueName: \"kubernetes.io/projected/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-kube-api-access-5rx4c\") pod \"cluster-monitoring-operator-548b489cb8-q7tkb\" (UID: \"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:17:37.157948 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.157891 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x5b8\" (UniqueName: \"kubernetes.io/projected/33871ba5-4d43-4229-a3f6-895af4883834-kube-api-access-8x5b8\") pod \"volume-data-source-validator-549c6d54cf-sx56s\" (UID: \"33871ba5-4d43-4229-a3f6-895af4883834\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sx56s" Jul 29 19:17:37.164536 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.164505 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-8hgcl"] Jul 29 19:17:37.164625 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.164576 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-dtrcq" Jul 29 19:17:37.166323 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.166308 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-t6pdd\"" Jul 29 19:17:37.186049 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.186026 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v"] Jul 29 19:17:37.186049 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.186053 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-dtrcq"] Jul 29 19:17:37.186219 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.186070 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-8hgcl"] Jul 29 19:17:37.186219 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.186153 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.188100 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.188084 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 29 19:17:37.188317 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.188300 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 19:17:37.188669 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.188653 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xfcnt\"" Jul 29 19:17:37.188723 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.188691 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 19:17:37.188764 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.188733 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 29 19:17:37.214108 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.214086 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 29 19:17:37.222826 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.222801 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:37.243872 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.243852 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f708385-526b-408f-98fe-03b81ef5fb6b-serving-cert\") pod \"console-operator-584dcb6b54-q5gv2\" (UID: \"4f708385-526b-408f-98fe-03b81ef5fb6b\") " pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:37.243960 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.243881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f708385-526b-408f-98fe-03b81ef5fb6b-trusted-ca\") pod \"console-operator-584dcb6b54-q5gv2\" (UID: \"4f708385-526b-408f-98fe-03b81ef5fb6b\") " pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:37.243960 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.243907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m5h2\" (UniqueName: \"kubernetes.io/projected/4f708385-526b-408f-98fe-03b81ef5fb6b-kube-api-access-8m5h2\") pod \"console-operator-584dcb6b54-q5gv2\" (UID: \"4f708385-526b-408f-98fe-03b81ef5fb6b\") " pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:37.244071 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.244050 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-serving-cert\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.244122 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.244094 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fvtq\" (UniqueName: \"kubernetes.io/projected/43a9ff3e-13e7-4098-b729-711de6048162-kube-api-access-4fvtq\") pod \"service-ca-operator-5d6c75f84f-48ltl\" (UID: \"43a9ff3e-13e7-4098-b729-711de6048162\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl" Jul 29 19:17:37.244172 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.244132 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k46kl\" (UniqueName: \"kubernetes.io/projected/00daf99c-cd3c-4ce7-907c-d03b8d0f7325-kube-api-access-k46kl\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v\" (UID: \"00daf99c-cd3c-4ce7-907c-d03b8d0f7325\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v" Jul 29 19:17:37.244172 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.244162 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6fwh\" (UID: \"9a1fc677-c956-43c1-86b9-6db625fed39b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" Jul 29 19:17:37.244272 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.244184 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-tmp\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.245082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.244619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qbfk\" (UniqueName: \"kubernetes.io/projected/0ceca3ca-683a-440b-bfc3-45ef1f19a8ee-kube-api-access-2qbfk\") pod \"network-check-source-7d88cb55d8-dtrcq\" (UID: \"0ceca3ca-683a-440b-bfc3-45ef1f19a8ee\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-dtrcq" Jul 29 19:17:37.245082 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:37.244684 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 19:17:37.245082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.244714 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znrp6\" (UniqueName: \"kubernetes.io/projected/9a1fc677-c956-43c1-86b9-6db625fed39b-kube-api-access-znrp6\") pod \"cluster-samples-operator-6748489656-m6fwh\" (UID: \"9a1fc677-c956-43c1-86b9-6db625fed39b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" Jul 29 19:17:37.245082 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:37.244747 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls podName:9a1fc677-c956-43c1-86b9-6db625fed39b nodeName:}" failed. No retries permitted until 2026-07-29 19:17:37.74473276 +0000 UTC m=+47.633039964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls") pod "cluster-samples-operator-6748489656-m6fwh" (UID: "9a1fc677-c956-43c1-86b9-6db625fed39b") : secret "samples-operator-tls" not found Jul 29 19:17:37.245082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.244770 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43a9ff3e-13e7-4098-b729-711de6048162-serving-cert\") pod \"service-ca-operator-5d6c75f84f-48ltl\" (UID: \"43a9ff3e-13e7-4098-b729-711de6048162\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl" Jul 29 19:17:37.245082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.244811 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/00daf99c-cd3c-4ce7-907c-d03b8d0f7325-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v\" (UID: \"00daf99c-cd3c-4ce7-907c-d03b8d0f7325\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v" Jul 29 19:17:37.245082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.244866 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-service-ca-bundle\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.245082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.245005 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlhpx\" (UniqueName: \"kubernetes.io/projected/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-kube-api-access-tlhpx\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.245082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.245050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7shrk\" (UniqueName: \"kubernetes.io/projected/c6ca279a-a264-44bc-b405-6ab87672b286-kube-api-access-7shrk\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:37.246720 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.245269 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f708385-526b-408f-98fe-03b81ef5fb6b-config\") pod \"console-operator-584dcb6b54-q5gv2\" (UID: \"4f708385-526b-408f-98fe-03b81ef5fb6b\") " pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:37.246720 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.245344 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:37.246720 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.245460 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:37.246720 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.245505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00daf99c-cd3c-4ce7-907c-d03b8d0f7325-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v\" (UID: \"00daf99c-cd3c-4ce7-907c-d03b8d0f7325\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v" Jul 29 19:17:37.246720 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.245570 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.246720 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:37.245661 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle podName:c6ca279a-a264-44bc-b405-6ab87672b286 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:37.745641021 +0000 UTC m=+47.633948455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle") pod "router-default-7bb4465977-m9lgt" (UID: "c6ca279a-a264-44bc-b405-6ab87672b286") : configmap references non-existent config key: service-ca.crt Jul 29 19:17:37.246720 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.245689 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-default-certificate\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:37.246720 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.245734 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-snapshots\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.246720 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.245783 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-stats-auth\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:37.246720 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:37.245794 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 19:17:37.246720 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.245830 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43a9ff3e-13e7-4098-b729-711de6048162-config\") pod \"service-ca-operator-5d6c75f84f-48ltl\" (UID: \"43a9ff3e-13e7-4098-b729-711de6048162\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl" Jul 29 19:17:37.246720 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:37.245861 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs podName:c6ca279a-a264-44bc-b405-6ab87672b286 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:37.745840529 +0000 UTC m=+47.634147734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs") pod "router-default-7bb4465977-m9lgt" (UID: "c6ca279a-a264-44bc-b405-6ab87672b286") : secret "router-metrics-certs-default" not found Jul 29 19:17:37.246720 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.246057 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4f708385-526b-408f-98fe-03b81ef5fb6b-config\") pod \"console-operator-584dcb6b54-q5gv2\" (UID: \"4f708385-526b-408f-98fe-03b81ef5fb6b\") " pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:37.246720 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.246374 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43a9ff3e-13e7-4098-b729-711de6048162-config\") pod \"service-ca-operator-5d6c75f84f-48ltl\" (UID: \"43a9ff3e-13e7-4098-b729-711de6048162\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl" Jul 29 19:17:37.247460 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.247437 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43a9ff3e-13e7-4098-b729-711de6048162-serving-cert\") pod \"service-ca-operator-5d6c75f84f-48ltl\" (UID: \"43a9ff3e-13e7-4098-b729-711de6048162\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl" Jul 29 19:17:37.249707 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.249627 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-stats-auth\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:37.249918 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.249897 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f708385-526b-408f-98fe-03b81ef5fb6b-trusted-ca\") pod \"console-operator-584dcb6b54-q5gv2\" (UID: \"4f708385-526b-408f-98fe-03b81ef5fb6b\") " pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:37.250024 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.250004 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f708385-526b-408f-98fe-03b81ef5fb6b-serving-cert\") pod \"console-operator-584dcb6b54-q5gv2\" (UID: \"4f708385-526b-408f-98fe-03b81ef5fb6b\") " pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:37.251217 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.251198 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-default-certificate\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:37.254111 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.254086 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m5h2\" (UniqueName: \"kubernetes.io/projected/4f708385-526b-408f-98fe-03b81ef5fb6b-kube-api-access-8m5h2\") pod \"console-operator-584dcb6b54-q5gv2\" (UID: \"4f708385-526b-408f-98fe-03b81ef5fb6b\") " pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:37.254235 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.254193 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fvtq\" (UniqueName: \"kubernetes.io/projected/43a9ff3e-13e7-4098-b729-711de6048162-kube-api-access-4fvtq\") pod \"service-ca-operator-5d6c75f84f-48ltl\" (UID: \"43a9ff3e-13e7-4098-b729-711de6048162\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl" Jul 29 19:17:37.254893 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.254868 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znrp6\" (UniqueName: \"kubernetes.io/projected/9a1fc677-c956-43c1-86b9-6db625fed39b-kube-api-access-znrp6\") pod \"cluster-samples-operator-6748489656-m6fwh\" (UID: \"9a1fc677-c956-43c1-86b9-6db625fed39b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" Jul 29 19:17:37.256109 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.256092 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7shrk\" (UniqueName: \"kubernetes.io/projected/c6ca279a-a264-44bc-b405-6ab87672b286-kube-api-access-7shrk\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:37.299062 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.299036 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:37.339855 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.339833 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sx56s" Jul 29 19:17:37.346223 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.346201 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00daf99c-cd3c-4ce7-907c-d03b8d0f7325-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v\" (UID: \"00daf99c-cd3c-4ce7-907c-d03b8d0f7325\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v" Jul 29 19:17:37.346309 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.346230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.346309 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.346258 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-snapshots\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.346309 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.346291 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-serving-cert\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.346490 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.346471 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k46kl\" (UniqueName: \"kubernetes.io/projected/00daf99c-cd3c-4ce7-907c-d03b8d0f7325-kube-api-access-k46kl\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v\" (UID: \"00daf99c-cd3c-4ce7-907c-d03b8d0f7325\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v" Jul 29 19:17:37.346567 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.346552 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-tmp\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.346621 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.346585 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qbfk\" (UniqueName: \"kubernetes.io/projected/0ceca3ca-683a-440b-bfc3-45ef1f19a8ee-kube-api-access-2qbfk\") pod \"network-check-source-7d88cb55d8-dtrcq\" (UID: \"0ceca3ca-683a-440b-bfc3-45ef1f19a8ee\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-dtrcq" Jul 29 19:17:37.346621 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.346615 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/00daf99c-cd3c-4ce7-907c-d03b8d0f7325-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v\" (UID: \"00daf99c-cd3c-4ce7-907c-d03b8d0f7325\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v" Jul 29 19:17:37.346723 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.346652 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-service-ca-bundle\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.346723 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.346677 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlhpx\" (UniqueName: \"kubernetes.io/projected/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-kube-api-access-tlhpx\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.347315 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.347289 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/00daf99c-cd3c-4ce7-907c-d03b8d0f7325-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v\" (UID: \"00daf99c-cd3c-4ce7-907c-d03b8d0f7325\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v" Jul 29 19:17:37.347375 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.347358 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.348410 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.348392 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00daf99c-cd3c-4ce7-907c-d03b8d0f7325-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v\" (UID: \"00daf99c-cd3c-4ce7-907c-d03b8d0f7325\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v" Jul 29 19:17:37.353315 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.353297 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k46kl\" (UniqueName: \"kubernetes.io/projected/00daf99c-cd3c-4ce7-907c-d03b8d0f7325-kube-api-access-k46kl\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v\" (UID: \"00daf99c-cd3c-4ce7-907c-d03b8d0f7325\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v" Jul 29 19:17:37.354075 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.354059 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qbfk\" (UniqueName: \"kubernetes.io/projected/0ceca3ca-683a-440b-bfc3-45ef1f19a8ee-kube-api-access-2qbfk\") pod \"network-check-source-7d88cb55d8-dtrcq\" (UID: \"0ceca3ca-683a-440b-bfc3-45ef1f19a8ee\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-dtrcq" Jul 29 19:17:37.354454 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.354426 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-tmp\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.354454 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.354454 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-snapshots\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.354601 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.354566 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-serving-cert\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.354670 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.354653 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-service-ca-bundle\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.356175 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.356156 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlhpx\" (UniqueName: \"kubernetes.io/projected/bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78-kube-api-access-tlhpx\") pod \"insights-operator-5885fdb759-8hgcl\" (UID: \"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78\") " pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.384573 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.384530 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:37.410266 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.410237 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl" Jul 29 19:17:37.418831 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.418798 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:37.461626 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.457274 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v" Jul 29 19:17:37.473493 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.472266 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-dtrcq" Jul 29 19:17:37.494927 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.494755 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-8hgcl" Jul 29 19:17:37.506310 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.506285 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sx56s"] Jul 29 19:17:37.509679 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:17:37.509649 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33871ba5_4d43_4229_a3f6_895af4883834.slice/crio-eeafc5b346089ce13eb84fa16a28c3b63e93a87f2a9d0c102a57816e803cd613 WatchSource:0}: Error finding container eeafc5b346089ce13eb84fa16a28c3b63e93a87f2a9d0c102a57816e803cd613: Status 404 returned error can't find the container with id eeafc5b346089ce13eb84fa16a28c3b63e93a87f2a9d0c102a57816e803cd613 Jul 29 19:17:37.509796 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.509733 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:37.571949 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.571878 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-q5gv2"] Jul 29 19:17:37.575141 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.575034 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:37.575600 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:17:37.575577 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f708385_526b_408f_98fe_03b81ef5fb6b.slice/crio-eda6c97fd9c8db8a5375461fc60e401a0819e3894b50e6b3ae9c7fed141b9293 WatchSource:0}: Error finding container eda6c97fd9c8db8a5375461fc60e401a0819e3894b50e6b3ae9c7fed141b9293: Status 404 returned error can't find the container with id eda6c97fd9c8db8a5375461fc60e401a0819e3894b50e6b3ae9c7fed141b9293 Jul 29 19:17:37.590521 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.590476 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl"] Jul 29 19:17:37.629728 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.629701 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v"] Jul 29 19:17:37.633353 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:17:37.633324 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00daf99c_cd3c_4ce7_907c_d03b8d0f7325.slice/crio-3be42558d02875e138d58d2d2a3a2e65d9932cccdbaa1edb0f0caf1af3e62c1d WatchSource:0}: Error finding container 3be42558d02875e138d58d2d2a3a2e65d9932cccdbaa1edb0f0caf1af3e62c1d: Status 404 returned error can't find the container with id 3be42558d02875e138d58d2d2a3a2e65d9932cccdbaa1edb0f0caf1af3e62c1d Jul 29 19:17:37.643834 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.643815 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-dtrcq"] Jul 29 19:17:37.646393 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:17:37.646372 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ceca3ca_683a_440b_bfc3_45ef1f19a8ee.slice/crio-9faf97866f10ac1e2821af9d66cbc78411d30ca300bb397bbc5b0b84e7ffe0dd WatchSource:0}: Error finding container 9faf97866f10ac1e2821af9d66cbc78411d30ca300bb397bbc5b0b84e7ffe0dd: Status 404 returned error can't find the container with id 9faf97866f10ac1e2821af9d66cbc78411d30ca300bb397bbc5b0b84e7ffe0dd Jul 29 19:17:37.653188 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.653162 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-q7tkb\" (UID: \"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:17:37.653364 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:37.653344 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 19:17:37.653433 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:37.653421 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls podName:a7ee0f3b-4ae1-4005-a5ae-cca1527207aa nodeName:}" failed. No retries permitted until 2026-07-29 19:17:38.653399545 +0000 UTC m=+48.541706752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-q7tkb" (UID: "a7ee0f3b-4ae1-4005-a5ae-cca1527207aa") : secret "cluster-monitoring-operator-tls" not found Jul 29 19:17:37.674767 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.674720 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-8hgcl"] Jul 29 19:17:37.677261 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:17:37.677243 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcda0b0e_7f9c_4b0d_8ec6_fe4a932a4d78.slice/crio-d98831f499a31fc813ab636ef769ff9f3568f3e3090c7df56416ab31dc320648 WatchSource:0}: Error finding container d98831f499a31fc813ab636ef769ff9f3568f3e3090c7df56416ab31dc320648: Status 404 returned error can't find the container with id d98831f499a31fc813ab636ef769ff9f3568f3e3090c7df56416ab31dc320648 Jul 29 19:17:37.753496 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.753467 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6fwh\" (UID: \"9a1fc677-c956-43c1-86b9-6db625fed39b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" Jul 29 19:17:37.753647 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:37.753607 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 19:17:37.753647 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.753635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:37.753721 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:37.753660 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls podName:9a1fc677-c956-43c1-86b9-6db625fed39b nodeName:}" failed. No retries permitted until 2026-07-29 19:17:38.753647348 +0000 UTC m=+48.641954557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls") pod "cluster-samples-operator-6748489656-m6fwh" (UID: "9a1fc677-c956-43c1-86b9-6db625fed39b") : secret "samples-operator-tls" not found Jul 29 19:17:37.753721 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.753686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:37.753804 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:37.753728 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle podName:c6ca279a-a264-44bc-b405-6ab87672b286 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:38.753711582 +0000 UTC m=+48.642018793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle") pod "router-default-7bb4465977-m9lgt" (UID: "c6ca279a-a264-44bc-b405-6ab87672b286") : configmap references non-existent config key: service-ca.crt Jul 29 19:17:37.753804 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:37.753757 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 19:17:37.753804 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:37.753782 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs podName:c6ca279a-a264-44bc-b405-6ab87672b286 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:38.753773286 +0000 UTC m=+48.642080490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs") pod "router-default-7bb4465977-m9lgt" (UID: "c6ca279a-a264-44bc-b405-6ab87672b286") : secret "router-metrics-certs-default" not found Jul 29 19:17:37.977899 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.977820 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-dtrcq" event={"ID":"0ceca3ca-683a-440b-bfc3-45ef1f19a8ee","Type":"ContainerStarted","Data":"9faf97866f10ac1e2821af9d66cbc78411d30ca300bb397bbc5b0b84e7ffe0dd"} Jul 29 19:17:37.978920 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.978885 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sx56s" event={"ID":"33871ba5-4d43-4229-a3f6-895af4883834","Type":"ContainerStarted","Data":"eeafc5b346089ce13eb84fa16a28c3b63e93a87f2a9d0c102a57816e803cd613"} Jul 29 19:17:37.979993 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.979969 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v" event={"ID":"00daf99c-cd3c-4ce7-907c-d03b8d0f7325","Type":"ContainerStarted","Data":"3be42558d02875e138d58d2d2a3a2e65d9932cccdbaa1edb0f0caf1af3e62c1d"} Jul 29 19:17:37.980946 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.980927 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl" event={"ID":"43a9ff3e-13e7-4098-b729-711de6048162","Type":"ContainerStarted","Data":"1c5cb22b48b873e7b7f5b654a249d18e13fb77022f80c6d878fe16821ee7dde9"} Jul 29 19:17:37.982063 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.982007 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" event={"ID":"4f708385-526b-408f-98fe-03b81ef5fb6b","Type":"ContainerStarted","Data":"eda6c97fd9c8db8a5375461fc60e401a0819e3894b50e6b3ae9c7fed141b9293"} Jul 29 19:17:37.983118 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:37.983098 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-8hgcl" event={"ID":"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78","Type":"ContainerStarted","Data":"d98831f499a31fc813ab636ef769ff9f3568f3e3090c7df56416ab31dc320648"} Jul 29 19:17:38.518776 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:38.518724 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:38.630312 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:38.630279 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:38.663420 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:38.662805 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-q7tkb\" (UID: \"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:17:38.663420 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:38.663031 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 19:17:38.663420 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:38.663093 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls podName:a7ee0f3b-4ae1-4005-a5ae-cca1527207aa nodeName:}" failed. No retries permitted until 2026-07-29 19:17:40.663074463 +0000 UTC m=+50.551381671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-q7tkb" (UID: "a7ee0f3b-4ae1-4005-a5ae-cca1527207aa") : secret "cluster-monitoring-operator-tls" not found Jul 29 19:17:38.763833 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:38.763799 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6fwh\" (UID: \"9a1fc677-c956-43c1-86b9-6db625fed39b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" Jul 29 19:17:38.763996 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:38.763898 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:38.763996 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:38.763928 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:38.763996 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:38.763952 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 19:17:38.764172 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:38.764011 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls podName:9a1fc677-c956-43c1-86b9-6db625fed39b nodeName:}" failed. No retries permitted until 2026-07-29 19:17:40.763993332 +0000 UTC m=+50.652300541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls") pod "cluster-samples-operator-6748489656-m6fwh" (UID: "9a1fc677-c956-43c1-86b9-6db625fed39b") : secret "samples-operator-tls" not found Jul 29 19:17:38.764172 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:38.764079 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle podName:c6ca279a-a264-44bc-b405-6ab87672b286 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:40.764057483 +0000 UTC m=+50.652364692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle") pod "router-default-7bb4465977-m9lgt" (UID: "c6ca279a-a264-44bc-b405-6ab87672b286") : configmap references non-existent config key: service-ca.crt Jul 29 19:17:38.764172 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:38.764099 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 19:17:38.764172 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:38.764149 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs podName:c6ca279a-a264-44bc-b405-6ab87672b286 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:40.764135488 +0000 UTC m=+50.652442707 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs") pod "router-default-7bb4465977-m9lgt" (UID: "c6ca279a-a264-44bc-b405-6ab87672b286") : secret "router-metrics-certs-default" not found Jul 29 19:17:40.379869 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:40.379803 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:40.380360 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:40.380002 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:40.380360 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:40.380024 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 19:17:40.380360 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:40.380049 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cfcf6c44b-wkzcc: secret "image-registry-tls" not found Jul 29 19:17:40.380360 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:40.380114 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls podName:a108a15f-f888-4215-8577-c0e957166d20 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:56.380089287 +0000 UTC m=+66.268396492 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls") pod "image-registry-6cfcf6c44b-wkzcc" (UID: "a108a15f-f888-4215-8577-c0e957166d20") : secret "image-registry-tls" not found Jul 29 19:17:40.380360 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:40.380125 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 19:17:40.380360 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:40.380179 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls podName:b46bb66d-8a39-4f0a-9758-25fc8b85804a nodeName:}" failed. No retries permitted until 2026-07-29 19:17:56.380162419 +0000 UTC m=+66.268469626 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls") pod "dns-default-lzdtw" (UID: "b46bb66d-8a39-4f0a-9758-25fc8b85804a") : secret "dns-default-metrics-tls" not found Jul 29 19:17:40.499415 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:40.499381 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:40.681821 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:40.681787 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-q7tkb\" (UID: \"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:17:40.681989 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:40.681887 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 19:17:40.681989 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:40.681947 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls podName:a7ee0f3b-4ae1-4005-a5ae-cca1527207aa nodeName:}" failed. No retries permitted until 2026-07-29 19:17:44.681929043 +0000 UTC m=+54.570236255 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-q7tkb" (UID: "a7ee0f3b-4ae1-4005-a5ae-cca1527207aa") : secret "cluster-monitoring-operator-tls" not found Jul 29 19:17:40.782393 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:40.782354 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:40.782393 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:40.782400 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:40.782650 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:40.782536 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 19:17:40.782650 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:40.782576 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6fwh\" (UID: \"9a1fc677-c956-43c1-86b9-6db625fed39b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" Jul 29 19:17:40.782650 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:40.782597 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs podName:c6ca279a-a264-44bc-b405-6ab87672b286 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:44.782578816 +0000 UTC m=+54.670886021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs") pod "router-default-7bb4465977-m9lgt" (UID: "c6ca279a-a264-44bc-b405-6ab87672b286") : secret "router-metrics-certs-default" not found Jul 29 19:17:40.782650 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:40.782620 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle podName:c6ca279a-a264-44bc-b405-6ab87672b286 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:44.782610129 +0000 UTC m=+54.670917334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle") pod "router-default-7bb4465977-m9lgt" (UID: "c6ca279a-a264-44bc-b405-6ab87672b286") : configmap references non-existent config key: service-ca.crt Jul 29 19:17:40.782863 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:40.782666 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 19:17:40.782863 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:40.782718 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls podName:9a1fc677-c956-43c1-86b9-6db625fed39b nodeName:}" failed. No retries permitted until 2026-07-29 19:17:44.7827025 +0000 UTC m=+54.671009704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls") pod "cluster-samples-operator-6748489656-m6fwh" (UID: "9a1fc677-c956-43c1-86b9-6db625fed39b") : secret "samples-operator-tls" not found Jul 29 19:17:42.186989 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:42.186951 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:44.013611 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.013574 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sx56s" event={"ID":"33871ba5-4d43-4229-a3f6-895af4883834","Type":"ContainerStarted","Data":"654fb42bf079b2f1bcc8df2b47a78d596d4b7e4d484762390577fb8168a58000"} Jul 29 19:17:44.015262 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.015236 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v" event={"ID":"00daf99c-cd3c-4ce7-907c-d03b8d0f7325","Type":"ContainerStarted","Data":"56906afafce7df566fbf0cbc4d4d22fa72e4929517e2ec51515392e802387667"} Jul 29 19:17:44.016949 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.016923 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl" event={"ID":"43a9ff3e-13e7-4098-b729-711de6048162","Type":"ContainerStarted","Data":"8c90b9902eb9e760fd4cc22974bda5844fc4c646dffc9e2f1c7dc00357d7b258"} Jul 29 19:17:44.018588 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.018570 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/0.log" Jul 29 19:17:44.018676 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.018601 2574 generic.go:356] "Generic (PLEG): container finished" podID="4f708385-526b-408f-98fe-03b81ef5fb6b" containerID="a1498653726ca5b2340c0564444fc6bfc1926dfcfa34ab7c3d2c9021293b3ec8" exitCode=255 Jul 29 19:17:44.018676 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.018628 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" event={"ID":"4f708385-526b-408f-98fe-03b81ef5fb6b","Type":"ContainerDied","Data":"a1498653726ca5b2340c0564444fc6bfc1926dfcfa34ab7c3d2c9021293b3ec8"} Jul 29 19:17:44.018856 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.018840 2574 scope.go:117] "RemoveContainer" containerID="a1498653726ca5b2340c0564444fc6bfc1926dfcfa34ab7c3d2c9021293b3ec8" Jul 29 19:17:44.020574 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.020551 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-8hgcl" event={"ID":"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78","Type":"ContainerStarted","Data":"2d6c3d1c94c7b7ed2239093048295383a2330058c4195673139557a8ceb925f2"} Jul 29 19:17:44.022384 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.022288 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-dtrcq" event={"ID":"0ceca3ca-683a-440b-bfc3-45ef1f19a8ee","Type":"ContainerStarted","Data":"e30c2a9f917f468dc052070572a3431660ee42df74e59089747ffc417f4cfaf4"} Jul 29 19:17:44.028789 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.028751 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-sx56s" podStartSLOduration=2.194062307 podStartE2EDuration="8.028716813s" totalImagesPullingTime="5.834654506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:44.028491735 +0000 UTC m=+53.916798963" watchObservedRunningTime="2026-07-29 19:17:44.028716813 +0000 UTC m=+53.917024038" Jul 29 19:17:44.047012 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.046429 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v" podStartSLOduration=1.3242860539999999 podStartE2EDuration="7.046412264s" totalImagesPullingTime="5.72212621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:44.045691258 +0000 UTC m=+53.933998486" watchObservedRunningTime="2026-07-29 19:17:44.046412264 +0000 UTC m=+53.934719492" Jul 29 19:17:44.060878 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.060811 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-dtrcq" podStartSLOduration=1.343488715 podStartE2EDuration="7.060794888s" totalImagesPullingTime="5.717306173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:44.059231277 +0000 UTC m=+53.947538501" watchObservedRunningTime="2026-07-29 19:17:44.060794888 +0000 UTC m=+53.949102118" Jul 29 19:17:44.081665 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.081612 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-8hgcl" podStartSLOduration=1.405616191 podStartE2EDuration="7.081593257s" totalImagesPullingTime="5.675977066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:44.081450155 +0000 UTC m=+53.969757384" watchObservedRunningTime="2026-07-29 19:17:44.081593257 +0000 UTC m=+53.969900476" Jul 29 19:17:44.117098 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.117040 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl" podStartSLOduration=2.355663941 podStartE2EDuration="8.117018277s" totalImagesPullingTime="5.761354336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:44.115805846 +0000 UTC m=+54.004113073" watchObservedRunningTime="2026-07-29 19:17:44.117018277 +0000 UTC m=+54.005325507" Jul 29 19:17:44.124881 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.124738 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:44.225423 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.225391 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:44.374495 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.374463 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:44.427796 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.427763 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:44.508558 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.508502 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:44.537055 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.537025 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-wqhst"] Jul 29 19:17:44.539309 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.539276 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wqhst" Jul 29 19:17:44.541116 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.541089 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 29 19:17:44.541223 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.541095 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 29 19:17:44.541458 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.541442 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lzvwr\"" Jul 29 19:17:44.549448 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.549427 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-wqhst"] Jul 29 19:17:44.610504 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.610472 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:44.618424 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.618361 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpk2x\" (UniqueName: \"kubernetes.io/projected/f88da9c8-4deb-4773-b937-31cbbfab0d33-kube-api-access-tpk2x\") pod \"migrator-6865c9967-wqhst\" (UID: \"f88da9c8-4deb-4773-b937-31cbbfab0d33\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wqhst" Jul 29 19:17:44.709760 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.709725 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:44.719800 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.719777 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-q7tkb\" (UID: \"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:17:44.719895 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.719813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpk2x\" (UniqueName: \"kubernetes.io/projected/f88da9c8-4deb-4773-b937-31cbbfab0d33-kube-api-access-tpk2x\") pod \"migrator-6865c9967-wqhst\" (UID: \"f88da9c8-4deb-4773-b937-31cbbfab0d33\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wqhst" Jul 29 19:17:44.719956 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:44.719934 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 19:17:44.720018 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:44.720006 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls podName:a7ee0f3b-4ae1-4005-a5ae-cca1527207aa nodeName:}" failed. No retries permitted until 2026-07-29 19:17:52.719986997 +0000 UTC m=+62.608294230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-q7tkb" (UID: "a7ee0f3b-4ae1-4005-a5ae-cca1527207aa") : secret "cluster-monitoring-operator-tls" not found Jul 29 19:17:44.727823 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.727790 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpk2x\" (UniqueName: \"kubernetes.io/projected/f88da9c8-4deb-4773-b937-31cbbfab0d33-kube-api-access-tpk2x\") pod \"migrator-6865c9967-wqhst\" (UID: \"f88da9c8-4deb-4773-b937-31cbbfab0d33\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wqhst" Jul 29 19:17:44.821017 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.820984 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6fwh\" (UID: \"9a1fc677-c956-43c1-86b9-6db625fed39b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" Jul 29 19:17:44.821227 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.821065 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:44.821227 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.821100 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:44.821227 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:44.821198 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 19:17:44.821379 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:44.821232 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 19:17:44.821379 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:44.821247 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle podName:c6ca279a-a264-44bc-b405-6ab87672b286 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:52.821222475 +0000 UTC m=+62.709529681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle") pod "router-default-7bb4465977-m9lgt" (UID: "c6ca279a-a264-44bc-b405-6ab87672b286") : configmap references non-existent config key: service-ca.crt Jul 29 19:17:44.821379 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:44.821276 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs podName:c6ca279a-a264-44bc-b405-6ab87672b286 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:52.821261919 +0000 UTC m=+62.709569146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs") pod "router-default-7bb4465977-m9lgt" (UID: "c6ca279a-a264-44bc-b405-6ab87672b286") : secret "router-metrics-certs-default" not found Jul 29 19:17:44.821379 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:44.821296 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls podName:9a1fc677-c956-43c1-86b9-6db625fed39b nodeName:}" failed. No retries permitted until 2026-07-29 19:17:52.821285095 +0000 UTC m=+62.709592300 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls") pod "cluster-samples-operator-6748489656-m6fwh" (UID: "9a1fc677-c956-43c1-86b9-6db625fed39b") : secret "samples-operator-tls" not found Jul 29 19:17:44.834931 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.834900 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vvjdl"] Jul 29 19:17:44.837424 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.837397 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:44.839595 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.839340 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 19:17:44.839595 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.839340 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 19:17:44.840192 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.840173 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nb5jk\"" Jul 29 19:17:44.847921 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.847853 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:44.849601 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.849577 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wqhst" Jul 29 19:17:44.853503 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.853480 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vvjdl"] Jul 29 19:17:44.922019 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.921992 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:44.922138 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.922026 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d147b8c7-251a-4c9d-aef7-35016719e787-data-volume\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:44.922138 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.922099 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:44.922201 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.922155 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc8qg\" (UniqueName: \"kubernetes.io/projected/d147b8c7-251a-4c9d-aef7-35016719e787-kube-api-access-qc8qg\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:44.922201 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.922183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d147b8c7-251a-4c9d-aef7-35016719e787-crio-socket\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:44.924711 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.924646 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:44.978266 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:44.978237 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-wqhst"] Jul 29 19:17:44.981307 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:17:44.981269 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88da9c8_4deb_4773_b937_31cbbfab0d33.slice/crio-6dcfb46a2c26510cce668a2174cdd505eff5bab4e8b00f676de44e8ae674ea3f WatchSource:0}: Error finding container 6dcfb46a2c26510cce668a2174cdd505eff5bab4e8b00f676de44e8ae674ea3f: Status 404 returned error can't find the container with id 6dcfb46a2c26510cce668a2174cdd505eff5bab4e8b00f676de44e8ae674ea3f Jul 29 19:17:45.022702 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.022678 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:45.023087 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.022748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc8qg\" (UniqueName: \"kubernetes.io/projected/d147b8c7-251a-4c9d-aef7-35016719e787-kube-api-access-qc8qg\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:45.023087 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.022798 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d147b8c7-251a-4c9d-aef7-35016719e787-crio-socket\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:45.023087 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:45.022834 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 19:17:45.023087 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.022847 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:45.023087 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.022876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d147b8c7-251a-4c9d-aef7-35016719e787-data-volume\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:45.023087 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:45.022893 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls podName:d147b8c7-251a-4c9d-aef7-35016719e787 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:45.522876082 +0000 UTC m=+55.411183287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvjdl" (UID: "d147b8c7-251a-4c9d-aef7-35016719e787") : secret "insights-runtime-extractor-tls" not found Jul 29 19:17:45.023087 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.022959 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d147b8c7-251a-4c9d-aef7-35016719e787-crio-socket\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:45.023087 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:45.023015 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 19:17:45.023087 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:45.023055 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm podName:d147b8c7-251a-4c9d-aef7-35016719e787 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:45.523046778 +0000 UTC m=+55.411353983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvjdl" (UID: "d147b8c7-251a-4c9d-aef7-35016719e787") : configmap "kube-rbac-proxy" not found Jul 29 19:17:45.023436 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.023154 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d147b8c7-251a-4c9d-aef7-35016719e787-data-volume\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:45.026602 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.026576 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:17:45.026968 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.026954 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/0.log" Jul 29 19:17:45.027022 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.026989 2574 generic.go:356] "Generic (PLEG): container finished" podID="4f708385-526b-408f-98fe-03b81ef5fb6b" containerID="e026330c524701aeca30178abeb45e4690eb6a9eb7dd9677082be7b165bcbc4e" exitCode=255 Jul 29 19:17:45.027102 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.027077 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" event={"ID":"4f708385-526b-408f-98fe-03b81ef5fb6b","Type":"ContainerDied","Data":"e026330c524701aeca30178abeb45e4690eb6a9eb7dd9677082be7b165bcbc4e"} Jul 29 19:17:45.027196 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.027138 2574 scope.go:117] "RemoveContainer" containerID="a1498653726ca5b2340c0564444fc6bfc1926dfcfa34ab7c3d2c9021293b3ec8" Jul 29 19:17:45.027363 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.027331 2574 scope.go:117] "RemoveContainer" containerID="e026330c524701aeca30178abeb45e4690eb6a9eb7dd9677082be7b165bcbc4e" Jul 29 19:17:45.027578 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:45.027552 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-q5gv2_openshift-console-operator(4f708385-526b-408f-98fe-03b81ef5fb6b)\"" pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" podUID="4f708385-526b-408f-98fe-03b81ef5fb6b" Jul 29 19:17:45.028402 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.028254 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wqhst" event={"ID":"f88da9c8-4deb-4773-b937-31cbbfab0d33","Type":"ContainerStarted","Data":"6dcfb46a2c26510cce668a2174cdd505eff5bab4e8b00f676de44e8ae674ea3f"} Jul 29 19:17:45.036553 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.036533 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc8qg\" (UniqueName: \"kubernetes.io/projected/d147b8c7-251a-4c9d-aef7-35016719e787-kube-api-access-qc8qg\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:45.529347 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.529309 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:45.529553 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:45.529410 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:45.529553 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:45.529478 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 19:17:45.529553 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:45.529485 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 19:17:45.529668 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:45.529564 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls podName:d147b8c7-251a-4c9d-aef7-35016719e787 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:46.529548593 +0000 UTC m=+56.417855799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvjdl" (UID: "d147b8c7-251a-4c9d-aef7-35016719e787") : secret "insights-runtime-extractor-tls" not found Jul 29 19:17:45.529668 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:45.529579 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm podName:d147b8c7-251a-4c9d-aef7-35016719e787 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:46.529572653 +0000 UTC m=+56.417879858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvjdl" (UID: "d147b8c7-251a-4c9d-aef7-35016719e787") : configmap "kube-rbac-proxy" not found Jul 29 19:17:46.032844 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.032815 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:17:46.033375 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.033151 2574 scope.go:117] "RemoveContainer" containerID="e026330c524701aeca30178abeb45e4690eb6a9eb7dd9677082be7b165bcbc4e" Jul 29 19:17:46.033375 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:46.033318 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-q5gv2_openshift-console-operator(4f708385-526b-408f-98fe-03b81ef5fb6b)\"" pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" podUID="4f708385-526b-408f-98fe-03b81ef5fb6b" Jul 29 19:17:46.444609 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.444582 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-97svm"] Jul 29 19:17:46.446565 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.446547 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-97svm" Jul 29 19:17:46.448589 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.448401 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 29 19:17:46.448589 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.448446 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 29 19:17:46.448589 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.448463 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 29 19:17:46.448786 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.448630 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 29 19:17:46.448786 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.448694 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7zctr\"" Jul 29 19:17:46.455083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.455061 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-97svm"] Jul 29 19:17:46.479059 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.479028 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:46.536197 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.536169 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:46.536315 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.536216 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bb485c9b-1655-45d3-9b9d-f8168d5cac31-signing-cabundle\") pod \"service-ca-658d7b7c78-97svm\" (UID: \"bb485c9b-1655-45d3-9b9d-f8168d5cac31\") " pod="openshift-service-ca/service-ca-658d7b7c78-97svm" Jul 29 19:17:46.536315 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.536242 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bb485c9b-1655-45d3-9b9d-f8168d5cac31-signing-key\") pod \"service-ca-658d7b7c78-97svm\" (UID: \"bb485c9b-1655-45d3-9b9d-f8168d5cac31\") " pod="openshift-service-ca/service-ca-658d7b7c78-97svm" Jul 29 19:17:46.536315 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.536264 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bchzn\" (UniqueName: \"kubernetes.io/projected/bb485c9b-1655-45d3-9b9d-f8168d5cac31-kube-api-access-bchzn\") pod \"service-ca-658d7b7c78-97svm\" (UID: \"bb485c9b-1655-45d3-9b9d-f8168d5cac31\") " pod="openshift-service-ca/service-ca-658d7b7c78-97svm" Jul 29 19:17:46.536315 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:46.536284 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 19:17:46.536536 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:46.536335 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm podName:d147b8c7-251a-4c9d-aef7-35016719e787 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:48.53632025 +0000 UTC m=+58.424627460 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvjdl" (UID: "d147b8c7-251a-4c9d-aef7-35016719e787") : configmap "kube-rbac-proxy" not found Jul 29 19:17:46.536536 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.536354 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:46.536536 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:46.536447 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 19:17:46.536536 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:46.536471 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls podName:d147b8c7-251a-4c9d-aef7-35016719e787 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:48.536463347 +0000 UTC m=+58.424770551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvjdl" (UID: "d147b8c7-251a-4c9d-aef7-35016719e787") : secret "insights-runtime-extractor-tls" not found Jul 29 19:17:46.637353 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.637325 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bb485c9b-1655-45d3-9b9d-f8168d5cac31-signing-cabundle\") pod \"service-ca-658d7b7c78-97svm\" (UID: \"bb485c9b-1655-45d3-9b9d-f8168d5cac31\") " pod="openshift-service-ca/service-ca-658d7b7c78-97svm" Jul 29 19:17:46.637467 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.637363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bb485c9b-1655-45d3-9b9d-f8168d5cac31-signing-key\") pod \"service-ca-658d7b7c78-97svm\" (UID: \"bb485c9b-1655-45d3-9b9d-f8168d5cac31\") " pod="openshift-service-ca/service-ca-658d7b7c78-97svm" Jul 29 19:17:46.637467 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.637380 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bchzn\" (UniqueName: \"kubernetes.io/projected/bb485c9b-1655-45d3-9b9d-f8168d5cac31-kube-api-access-bchzn\") pod \"service-ca-658d7b7c78-97svm\" (UID: \"bb485c9b-1655-45d3-9b9d-f8168d5cac31\") " pod="openshift-service-ca/service-ca-658d7b7c78-97svm" Jul 29 19:17:46.638048 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.638024 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bb485c9b-1655-45d3-9b9d-f8168d5cac31-signing-cabundle\") pod \"service-ca-658d7b7c78-97svm\" (UID: \"bb485c9b-1655-45d3-9b9d-f8168d5cac31\") " pod="openshift-service-ca/service-ca-658d7b7c78-97svm" Jul 29 19:17:46.640052 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.640025 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bb485c9b-1655-45d3-9b9d-f8168d5cac31-signing-key\") pod \"service-ca-658d7b7c78-97svm\" (UID: \"bb485c9b-1655-45d3-9b9d-f8168d5cac31\") " pod="openshift-service-ca/service-ca-658d7b7c78-97svm" Jul 29 19:17:46.645292 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.645269 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bchzn\" (UniqueName: \"kubernetes.io/projected/bb485c9b-1655-45d3-9b9d-f8168d5cac31-kube-api-access-bchzn\") pod \"service-ca-658d7b7c78-97svm\" (UID: \"bb485c9b-1655-45d3-9b9d-f8168d5cac31\") " pod="openshift-service-ca/service-ca-658d7b7c78-97svm" Jul 29 19:17:46.756416 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.756379 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-97svm" Jul 29 19:17:46.835929 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.835906 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m4qwh_44e454bf-8721-4247-b10c-9eb4f1d850b1/dns-node-resolver/0.log" Jul 29 19:17:46.878248 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:46.878221 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-97svm"] Jul 29 19:17:46.880817 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:17:46.880788 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb485c9b_1655_45d3_9b9d_f8168d5cac31.slice/crio-a51cf38c52438b3d6dcce3c1f6c6814457fa032211df9cc16f8aa0f314339a86 WatchSource:0}: Error finding container a51cf38c52438b3d6dcce3c1f6c6814457fa032211df9cc16f8aa0f314339a86: Status 404 returned error can't find the container with id a51cf38c52438b3d6dcce3c1f6c6814457fa032211df9cc16f8aa0f314339a86 Jul 29 19:17:47.038145 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:47.038109 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wqhst" event={"ID":"f88da9c8-4deb-4773-b937-31cbbfab0d33","Type":"ContainerStarted","Data":"c05086b6772e1bedc3e345c40f9d4647e310bc9eae69bee4a1ca64c0c7d29877"} Jul 29 19:17:47.038766 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:47.038173 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wqhst" event={"ID":"f88da9c8-4deb-4773-b937-31cbbfab0d33","Type":"ContainerStarted","Data":"af42e34e70405fa5638b523398e8d6fc68a4fa228d8aa35e8852cab83bfef8c3"} Jul 29 19:17:47.039759 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:47.039737 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-97svm" event={"ID":"bb485c9b-1655-45d3-9b9d-f8168d5cac31","Type":"ContainerStarted","Data":"ec93c9b875a41128c7e7ab8c7cbf6e5f4a9ccbbdf2abf16c8ecfc2d59ccacce4"} Jul 29 19:17:47.039854 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:47.039773 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-97svm" event={"ID":"bb485c9b-1655-45d3-9b9d-f8168d5cac31","Type":"ContainerStarted","Data":"a51cf38c52438b3d6dcce3c1f6c6814457fa032211df9cc16f8aa0f314339a86"} Jul 29 19:17:47.062334 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:47.062286 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-wqhst" podStartSLOduration=1.709308364 podStartE2EDuration="3.062269684s" totalImagesPullingTime="1.35296132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:47.06166288 +0000 UTC m=+56.949970131" watchObservedRunningTime="2026-07-29 19:17:47.062269684 +0000 UTC m=+56.950576911" Jul 29 19:17:47.080641 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:47.080594 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-97svm" podStartSLOduration=1.08057644 podStartE2EDuration="1.08057644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:47.079778746 +0000 UTC m=+56.968085967" watchObservedRunningTime="2026-07-29 19:17:47.08057644 +0000 UTC m=+56.968883668" Jul 29 19:17:47.385020 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:47.384992 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:47.385174 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:47.385073 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:47.385415 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:47.385403 2574 scope.go:117] "RemoveContainer" containerID="e026330c524701aeca30178abeb45e4690eb6a9eb7dd9677082be7b165bcbc4e" Jul 29 19:17:47.385581 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:47.385563 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-q5gv2_openshift-console-operator(4f708385-526b-408f-98fe-03b81ef5fb6b)\"" pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" podUID="4f708385-526b-408f-98fe-03b81ef5fb6b" Jul 29 19:17:47.434554 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:47.434505 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5wg8l_0fb4252c-4795-40b7-8f5e-e1f540f9ec8b/node-ca/0.log" Jul 29 19:17:47.501891 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:47.501843 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:48.220918 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:48.220863 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:48.235631 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:48.235600 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w9tlj_71ad3104-e1e8-44a1-91c2-7b877e8f66c1/serve-healthcheck-canary/0.log" Jul 29 19:17:48.375682 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:48.375638 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:48.442531 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:48.442422 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-wqhst_f88da9c8-4deb-4773-b937-31cbbfab0d33/migrator/0.log" Jul 29 19:17:48.474501 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:48.474403 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:48.554445 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:48.554412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:48.554644 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:48.554531 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:48.554712 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:48.554661 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 19:17:48.554712 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:48.554575 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 19:17:48.554816 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:48.554736 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls podName:d147b8c7-251a-4c9d-aef7-35016719e787 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:52.554715645 +0000 UTC m=+62.443022869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvjdl" (UID: "d147b8c7-251a-4c9d-aef7-35016719e787") : secret "insights-runtime-extractor-tls" not found Jul 29 19:17:48.554816 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:48.554755 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm podName:d147b8c7-251a-4c9d-aef7-35016719e787 nodeName:}" failed. No retries permitted until 2026-07-29 19:17:52.554746499 +0000 UTC m=+62.443053705 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvjdl" (UID: "d147b8c7-251a-4c9d-aef7-35016719e787") : configmap "kube-rbac-proxy" not found Jul 29 19:17:48.572141 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:48.572085 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:48.634978 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:48.634850 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-wqhst_f88da9c8-4deb-4773-b937-31cbbfab0d33/graceful-termination/0.log" Jul 29 19:17:48.677766 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:48.677723 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:48.773442 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:48.773345 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:48.837775 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:48.837739 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v_00daf99c-cd3c-4ce7-907c-d03b8d0f7325/kube-storage-version-migrator-operator/0.log" Jul 29 19:17:48.913919 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:48.913876 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:49.713398 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:49.713362 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:49.929335 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:49.929298 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dxx86" Jul 29 19:17:50.132264 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:50.132172 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:50.507567 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:50.507500 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:50.629077 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:50.629043 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:50.921124 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:50.921089 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:50.977386 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:50.977352 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:51.306802 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:51.306708 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:51.630184 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:51.630095 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:51.730663 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:51.730627 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:51.880396 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:51.880306 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:51.938578 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:51.938540 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:52.116058 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.116024 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:52.176506 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.176469 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:52.308743 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.308709 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:52.408126 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.408095 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:52.462396 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.462312 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:52.592339 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.592295 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:52.592566 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.592428 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:17:52.592566 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:52.592442 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 19:17:52.592566 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:52.592502 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls podName:d147b8c7-251a-4c9d-aef7-35016719e787 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:00.592486576 +0000 UTC m=+70.480793781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvjdl" (UID: "d147b8c7-251a-4c9d-aef7-35016719e787") : secret "insights-runtime-extractor-tls" not found Jul 29 19:17:52.592566 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:52.592544 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 19:17:52.592744 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:52.592601 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm podName:d147b8c7-251a-4c9d-aef7-35016719e787 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:00.592585383 +0000 UTC m=+70.480892613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvjdl" (UID: "d147b8c7-251a-4c9d-aef7-35016719e787") : configmap "kube-rbac-proxy" not found Jul 29 19:17:52.710793 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.710756 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:52.769816 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.769718 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:52.794361 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.794321 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-q7tkb\" (UID: \"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:17:52.794560 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:52.794450 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 19:17:52.794560 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:52.794528 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls podName:a7ee0f3b-4ae1-4005-a5ae-cca1527207aa nodeName:}" failed. No retries permitted until 2026-07-29 19:18:08.794497386 +0000 UTC m=+78.682804590 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-q7tkb" (UID: "a7ee0f3b-4ae1-4005-a5ae-cca1527207aa") : secret "cluster-monitoring-operator-tls" not found Jul 29 19:17:52.895874 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.895830 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6fwh\" (UID: \"9a1fc677-c956-43c1-86b9-6db625fed39b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" Jul 29 19:17:52.896071 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.895920 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:52.896071 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.895994 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:52.896165 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:17:52.896096 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle podName:c6ca279a-a264-44bc-b405-6ab87672b286 nodeName:}" failed. No retries permitted until 2026-07-29 19:18:08.896076338 +0000 UTC m=+78.784383550 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle") pod "router-default-7bb4465977-m9lgt" (UID: "c6ca279a-a264-44bc-b405-6ab87672b286") : configmap references non-existent config key: service-ca.crt Jul 29 19:17:52.898436 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.898405 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a1fc677-c956-43c1-86b9-6db625fed39b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6fwh\" (UID: \"9a1fc677-c956-43c1-86b9-6db625fed39b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" Jul 29 19:17:52.898554 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.898405 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6ca279a-a264-44bc-b405-6ab87672b286-metrics-certs\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:17:52.962591 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.962561 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-q9wcx\"" Jul 29 19:17:52.970871 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:52.970850 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" Jul 29 19:17:53.093277 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:53.093244 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh"] Jul 29 19:17:53.517358 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:53.517319 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:53.727210 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:53.727172 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:53.793049 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:53.792953 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:53.915262 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:53.915030 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:54.069333 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:54.069233 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" event={"ID":"9a1fc677-c956-43c1-86b9-6db625fed39b","Type":"ContainerStarted","Data":"5c965af56622b305bb8519904e31258236092fe44634a44c23a366c23434d9f6"} Jul 29 19:17:54.110313 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:54.107099 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:54.208428 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:54.208392 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:54.308967 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:54.308930 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:54.511667 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:54.511619 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:54.565949 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:54.565786 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:55.514154 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:55.514129 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:55.909765 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:55.909728 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:56.077658 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.077618 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" event={"ID":"9a1fc677-c956-43c1-86b9-6db625fed39b","Type":"ContainerStarted","Data":"705432d6a29c2c54c94af39f40f50fae8e04714b29a892c0bd2f179f0a5636be"} Jul 29 19:17:56.077851 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.077674 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" event={"ID":"9a1fc677-c956-43c1-86b9-6db625fed39b","Type":"ContainerStarted","Data":"9444ab0b7cfa0b4c8894c04579a8e342224470011c8ee4e321992d819ca83b87"} Jul 29 19:17:56.111102 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.111047 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6fwh" podStartSLOduration=17.964022375 podStartE2EDuration="20.111029532s" totalImagesPullingTime="2.147007157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:56.10667663 +0000 UTC m=+65.994983859" watchObservedRunningTime="2026-07-29 19:17:56.111029532 +0000 UTC m=+65.999336759" Jul 29 19:17:56.128002 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.127962 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:56.314576 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.314469 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:56.326776 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.326743 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs\") pod \"network-metrics-daemon-tvjjw\" (UID: \"8dd28ca5-aeb7-4eb9-b38d-827f82b57d61\") " pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:56.329072 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.329053 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 19:17:56.339817 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.339781 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd28ca5-aeb7-4eb9-b38d-827f82b57d61-metrics-certs\") pod \"network-metrics-daemon-tvjjw\" (UID: \"8dd28ca5-aeb7-4eb9-b38d-827f82b57d61\") " pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:56.427658 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.427601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:56.427939 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.427672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:56.427939 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.427719 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret\") pod \"global-pull-secret-syncer-7plmd\" (UID: \"9521677d-7019-45f6-8e84-472a86d51c00\") " pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:56.430101 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.430079 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls\") pod \"image-registry-6cfcf6c44b-wkzcc\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:56.430192 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.430078 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b46bb66d-8a39-4f0a-9758-25fc8b85804a-metrics-tls\") pod \"dns-default-lzdtw\" (UID: \"b46bb66d-8a39-4f0a-9758-25fc8b85804a\") " pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:56.430487 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.430466 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 19:17:56.439976 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.439947 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9521677d-7019-45f6-8e84-472a86d51c00-original-pull-secret\") pod \"global-pull-secret-syncer-7plmd\" (UID: \"9521677d-7019-45f6-8e84-472a86d51c00\") " pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:56.510504 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.510462 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:56.528549 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.528490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7l6\" (UniqueName: \"kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6\") pod \"network-check-target-9gg2k\" (UID: \"ca94bfdc-31fd-44d4-a87a-a507fa3ef39c\") " pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:56.531102 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.531079 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr7l6\" (UniqueName: \"kubernetes.io/projected/ca94bfdc-31fd-44d4-a87a-a507fa3ef39c-kube-api-access-xr7l6\") pod \"network-check-target-9gg2k\" (UID: \"ca94bfdc-31fd-44d4-a87a-a507fa3ef39c\") " pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:56.579522 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.579413 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qxkk6\"" Jul 29 19:17:56.582939 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.582921 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7plmd" Jul 29 19:17:56.587741 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.587535 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tvjjw" Jul 29 19:17:56.590138 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.590117 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b2qz7\"" Jul 29 19:17:56.598095 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.598071 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:56.652123 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.651912 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xs7xs\"" Jul 29 19:17:56.657907 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.657872 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:56.663208 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.662285 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hhdrq\"" Jul 29 19:17:56.669565 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.669360 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lzdtw" Jul 29 19:17:56.763887 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.763634 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7plmd"] Jul 29 19:17:56.809300 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.809055 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tvjjw"] Jul 29 19:17:56.812325 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:17:56.812292 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd28ca5_aeb7_4eb9_b38d_827f82b57d61.slice/crio-8e77e19c50b642b73e41732daad0d86bfc23d30fd7f1e988be579c2fd01e22a2 WatchSource:0}: Error finding container 8e77e19c50b642b73e41732daad0d86bfc23d30fd7f1e988be579c2fd01e22a2: Status 404 returned error can't find the container with id 8e77e19c50b642b73e41732daad0d86bfc23d30fd7f1e988be579c2fd01e22a2 Jul 29 19:17:56.831390 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.831312 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9gg2k"] Jul 29 19:17:56.834605 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:17:56.834545 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca94bfdc_31fd_44d4_a87a_a507fa3ef39c.slice/crio-36adc892089f0a3090a55a60c3b490c7934b1ce85dc45b0e796ffe2302bc774e WatchSource:0}: Error finding container 36adc892089f0a3090a55a60c3b490c7934b1ce85dc45b0e796ffe2302bc774e: Status 404 returned error can't find the container with id 36adc892089f0a3090a55a60c3b490c7934b1ce85dc45b0e796ffe2302bc774e Jul 29 19:17:56.875367 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.875344 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lzdtw"] Jul 29 19:17:56.878473 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:17:56.878445 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46bb66d_8a39_4f0a_9758_25fc8b85804a.slice/crio-97f6042fdaef4aea7dd7ef7581e209aa6782072f063901e344e397ba6d2fa0aa WatchSource:0}: Error finding container 97f6042fdaef4aea7dd7ef7581e209aa6782072f063901e344e397ba6d2fa0aa: Status 404 returned error can't find the container with id 97f6042fdaef4aea7dd7ef7581e209aa6782072f063901e344e397ba6d2fa0aa Jul 29 19:17:56.892960 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:56.892933 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cfcf6c44b-wkzcc"] Jul 29 19:17:56.896053 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:17:56.896030 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda108a15f_f888_4215_8577_c0e957166d20.slice/crio-5e127af8bec6c5cf25d39d0433603fb244fd2e098ab4a5f609bdc81da18cdd83 WatchSource:0}: Error finding container 5e127af8bec6c5cf25d39d0433603fb244fd2e098ab4a5f609bdc81da18cdd83: Status 404 returned error can't find the container with id 5e127af8bec6c5cf25d39d0433603fb244fd2e098ab4a5f609bdc81da18cdd83 Jul 29 19:17:57.082943 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:57.082856 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tvjjw" event={"ID":"8dd28ca5-aeb7-4eb9-b38d-827f82b57d61","Type":"ContainerStarted","Data":"8e77e19c50b642b73e41732daad0d86bfc23d30fd7f1e988be579c2fd01e22a2"} Jul 29 19:17:57.084059 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:57.084028 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lzdtw" event={"ID":"b46bb66d-8a39-4f0a-9758-25fc8b85804a","Type":"ContainerStarted","Data":"97f6042fdaef4aea7dd7ef7581e209aa6782072f063901e344e397ba6d2fa0aa"} Jul 29 19:17:57.088827 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:57.088788 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" event={"ID":"a108a15f-f888-4215-8577-c0e957166d20","Type":"ContainerStarted","Data":"dcae01d1b228303a4fbd03c72c945e5eea9ed7a2f1f2cf606db32e11f94c2f62"} Jul 29 19:17:57.088942 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:57.088836 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" event={"ID":"a108a15f-f888-4215-8577-c0e957166d20","Type":"ContainerStarted","Data":"5e127af8bec6c5cf25d39d0433603fb244fd2e098ab4a5f609bdc81da18cdd83"} Jul 29 19:17:57.088942 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:57.088884 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:17:57.090318 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:57.090288 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7plmd" event={"ID":"9521677d-7019-45f6-8e84-472a86d51c00","Type":"ContainerStarted","Data":"a6658ea4104523d09039860030c81c8295d40bff0326ce635ff016ab0b8b6179"} Jul 29 19:17:57.091782 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:57.091761 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9gg2k" event={"ID":"ca94bfdc-31fd-44d4-a87a-a507fa3ef39c","Type":"ContainerStarted","Data":"2e4ec7825d351011e22347c26fc322a9441aa43eee3f4f22168053d6e8d909d6"} Jul 29 19:17:57.091880 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:57.091805 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9gg2k" event={"ID":"ca94bfdc-31fd-44d4-a87a-a507fa3ef39c","Type":"ContainerStarted","Data":"36adc892089f0a3090a55a60c3b490c7934b1ce85dc45b0e796ffe2302bc774e"} Jul 29 19:17:57.091880 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:57.091858 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:17:57.108715 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:57.108652 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" podStartSLOduration=66.108630162 podStartE2EDuration="1m6.108630162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:16:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:57.107229348 +0000 UTC m=+66.995536574" watchObservedRunningTime="2026-07-29 19:17:57.108630162 +0000 UTC m=+66.996937389" Jul 29 19:17:57.122527 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:57.122453 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9gg2k" podStartSLOduration=66.12243136 podStartE2EDuration="1m6.12243136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:16:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:57.122117653 +0000 UTC m=+67.010424882" watchObservedRunningTime="2026-07-29 19:17:57.12243136 +0000 UTC m=+67.010738587" Jul 29 19:17:57.513283 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:57.513169 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:57.567868 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:57.567782 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:57.711370 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:57.711315 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:57.908072 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:57.908034 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:58.309250 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:58.309150 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:58.713304 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:58.713266 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:58.728033 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:58.728003 2574 scope.go:117] "RemoveContainer" containerID="e026330c524701aeca30178abeb45e4690eb6a9eb7dd9677082be7b165bcbc4e" Jul 29 19:17:58.950381 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:58.950338 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:17:59.104116 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:59.104086 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:17:59.105064 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:59.104249 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" event={"ID":"4f708385-526b-408f-98fe-03b81ef5fb6b","Type":"ContainerStarted","Data":"e89dff1059627f8391186ca4e01a3a3f1dd9282912d0844a5db991f5094f87fb"} Jul 29 19:17:59.105064 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:59.105019 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:17:59.106491 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:59.106425 2574 patch_prober.go:28] interesting pod/console-operator-584dcb6b54-q5gv2 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" start-of-body= Jul 29 19:17:59.106667 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:59.106477 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" podUID="4f708385-526b-408f-98fe-03b81ef5fb6b" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" Jul 29 19:17:59.107711 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:59.107641 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tvjjw" event={"ID":"8dd28ca5-aeb7-4eb9-b38d-827f82b57d61","Type":"ContainerStarted","Data":"627aedeb3142113c53c6d7158ea5c965fb12c2cee04274852670076fc63030a3"} Jul 29 19:17:59.107711 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:59.107687 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tvjjw" event={"ID":"8dd28ca5-aeb7-4eb9-b38d-827f82b57d61","Type":"ContainerStarted","Data":"757f190340ec263ea04c7a9ba2acb49d509a9ba4b03d3f40f9b6793f70e79218"} Jul 29 19:17:59.124662 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:59.123482 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" podStartSLOduration=17.342190431 podStartE2EDuration="23.123466841s" totalImagesPullingTime="5.78127641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:59.123437631 +0000 UTC m=+69.011744863" watchObservedRunningTime="2026-07-29 19:17:59.123466841 +0000 UTC m=+69.011774074" Jul 29 19:17:59.138583 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:17:59.138524 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tvjjw" podStartSLOduration=66.877376288 podStartE2EDuration="1m8.138488184s" totalImagesPullingTime="1.261111896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:17:59.137588326 +0000 UTC m=+69.025895554" watchObservedRunningTime="2026-07-29 19:17:59.138488184 +0000 UTC m=+69.026795414" Jul 29 19:18:00.022527 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.022469 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:00.114117 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.114076 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lzdtw" event={"ID":"b46bb66d-8a39-4f0a-9758-25fc8b85804a","Type":"ContainerStarted","Data":"89a339b66c7c93dd72eb35347bb81228593452068494f78c2a9401f05cd2e6f3"} Jul 29 19:18:00.114656 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.114569 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lzdtw" Jul 29 19:18:00.114656 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.114619 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lzdtw" event={"ID":"b46bb66d-8a39-4f0a-9758-25fc8b85804a","Type":"ContainerStarted","Data":"99cc868d72a25bd9647fcb2b6378c7d8bd9071e593fc1609d7874f2edfec2586"} Jul 29 19:18:00.119366 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.119340 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-q5gv2" Jul 29 19:18:00.122488 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.122447 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:00.132136 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.132085 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lzdtw" podStartSLOduration=33.986536002 podStartE2EDuration="36.132066744s" totalImagesPullingTime="2.145530742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:00.130664681 +0000 UTC m=+70.018971909" watchObservedRunningTime="2026-07-29 19:18:00.132066744 +0000 UTC m=+70.020373971" Jul 29 19:18:00.175824 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.175786 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:00.311543 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.311446 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:00.671678 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.671633 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:18:00.671881 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.671771 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:18:00.672438 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.672409 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d147b8c7-251a-4c9d-aef7-35016719e787-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:18:00.674591 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.674559 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d147b8c7-251a-4c9d-aef7-35016719e787-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvjdl\" (UID: \"d147b8c7-251a-4c9d-aef7-35016719e787\") " pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:18:00.690215 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.690176 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:00.746186 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.746151 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:00.751845 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.751820 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nb5jk\"" Jul 29 19:18:00.760298 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.760276 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vvjdl" Jul 29 19:18:00.907523 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.907473 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:00.976859 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:00.976681 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:01.123153 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:01.123111 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:01.186456 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:01.186415 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:01.356377 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:01.356347 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vvjdl"] Jul 29 19:18:01.359551 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:18:01.359526 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd147b8c7_251a_4c9d_aef7_35016719e787.slice/crio-8b43cc4ffa53f83466a103b3759621ffa2611abed4b8d85fe865cc6a115cea34 WatchSource:0}: Error finding container 8b43cc4ffa53f83466a103b3759621ffa2611abed4b8d85fe865cc6a115cea34: Status 404 returned error can't find the container with id 8b43cc4ffa53f83466a103b3759621ffa2611abed4b8d85fe865cc6a115cea34 Jul 29 19:18:01.510041 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:01.510006 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:01.704102 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:01.704070 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:01.805992 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:01.805959 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:02.122717 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:02.122631 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvjdl" event={"ID":"d147b8c7-251a-4c9d-aef7-35016719e787","Type":"ContainerStarted","Data":"8b43cc4ffa53f83466a103b3759621ffa2611abed4b8d85fe865cc6a115cea34"} Jul 29 19:18:02.124115 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:02.124085 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7plmd" event={"ID":"9521677d-7019-45f6-8e84-472a86d51c00","Type":"ContainerStarted","Data":"c63829aa2e4111206fe61866dc68a055091d59be52156f31c0b6ba89c228133f"} Jul 29 19:18:02.140886 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:02.140834 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7plmd" podStartSLOduration=66.642114251 podStartE2EDuration="1m11.140815952s" totalImagesPullingTime="4.498701701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:02.139791245 +0000 UTC m=+72.028098473" watchObservedRunningTime="2026-07-29 19:18:02.140815952 +0000 UTC m=+72.029123217" Jul 29 19:18:02.526497 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:02.526456 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:02.636707 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:02.636641 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:04.072143 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:04.072100 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:04.172954 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:04.172907 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:07.147876 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:07.147839 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvjdl" event={"ID":"d147b8c7-251a-4c9d-aef7-35016719e787","Type":"ContainerStarted","Data":"df3449e3a5a2d6f2eeba1130fc08acab6c26acebcc469185fca97ef7cf94d6ad"} Jul 29 19:18:07.326032 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:07.325982 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:08.846838 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:08.846803 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-q7tkb\" (UID: \"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:18:08.849603 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:08.849575 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7ee0f3b-4ae1-4005-a5ae-cca1527207aa-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-q7tkb\" (UID: \"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:18:08.948037 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:08.947996 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:18:08.948733 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:08.948705 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ca279a-a264-44bc-b405-6ab87672b286-service-ca-bundle\") pod \"router-default-7bb4465977-m9lgt\" (UID: \"c6ca279a-a264-44bc-b405-6ab87672b286\") " pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:18:09.058740 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.058713 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fw749\"" Jul 29 19:18:09.065757 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.065724 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" Jul 29 19:18:09.180533 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.180482 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:09.191649 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.191618 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-grl5c"] Jul 29 19:18:09.196191 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.196163 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-grl5c" Jul 29 19:18:09.198261 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.198234 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hbx5p\"" Jul 29 19:18:09.198545 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.198505 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 19:18:09.198663 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.198652 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 19:18:09.207449 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.207401 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-grl5c"] Jul 29 19:18:09.227087 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.227015 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kgtcm\"" Jul 29 19:18:09.235792 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.235756 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:18:09.279923 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.279884 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:09.350706 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.350660 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnrmv\" (UniqueName: \"kubernetes.io/projected/5c69d0c5-b5bd-4bf5-9c22-70c9d5bce5e7-kube-api-access-qnrmv\") pod \"downloads-7c97dc4555-grl5c\" (UID: \"5c69d0c5-b5bd-4bf5-9c22-70c9d5bce5e7\") " pod="openshift-console/downloads-7c97dc4555-grl5c" Jul 29 19:18:09.381907 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.381867 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:09.451822 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.451741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnrmv\" (UniqueName: \"kubernetes.io/projected/5c69d0c5-b5bd-4bf5-9c22-70c9d5bce5e7-kube-api-access-qnrmv\") pod \"downloads-7c97dc4555-grl5c\" (UID: \"5c69d0c5-b5bd-4bf5-9c22-70c9d5bce5e7\") " pod="openshift-console/downloads-7c97dc4555-grl5c" Jul 29 19:18:09.462073 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.462040 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnrmv\" (UniqueName: \"kubernetes.io/projected/5c69d0c5-b5bd-4bf5-9c22-70c9d5bce5e7-kube-api-access-qnrmv\") pod \"downloads-7c97dc4555-grl5c\" (UID: \"5c69d0c5-b5bd-4bf5-9c22-70c9d5bce5e7\") " pod="openshift-console/downloads-7c97dc4555-grl5c" Jul 29 19:18:09.474985 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.474944 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:09.509685 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:09.509648 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-grl5c" Jul 29 19:18:10.344311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:10.344281 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-grl5c"] Jul 29 19:18:10.347923 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:18:10.347892 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c69d0c5_b5bd_4bf5_9c22_70c9d5bce5e7.slice/crio-9cf390818015a23054ad7e49d4addcc0735804e3b0780e86eaaec0bd4bf9fcc1 WatchSource:0}: Error finding container 9cf390818015a23054ad7e49d4addcc0735804e3b0780e86eaaec0bd4bf9fcc1: Status 404 returned error can't find the container with id 9cf390818015a23054ad7e49d4addcc0735804e3b0780e86eaaec0bd4bf9fcc1 Jul 29 19:18:10.488458 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:10.488369 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:10.549612 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:10.549567 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:10.570244 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:10.570218 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb"] Jul 29 19:18:10.573808 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:18:10.573784 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ee0f3b_4ae1_4005_a5ae_cca1527207aa.slice/crio-d01b47c60ec02bc7021542e0cbf6944bcc775bace845e87e5522f78444eefc49 WatchSource:0}: Error finding container d01b47c60ec02bc7021542e0cbf6944bcc775bace845e87e5522f78444eefc49: Status 404 returned error can't find the container with id d01b47c60ec02bc7021542e0cbf6944bcc775bace845e87e5522f78444eefc49 Jul 29 19:18:10.574660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:10.574619 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bb4465977-m9lgt"] Jul 29 19:18:10.576551 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:18:10.576529 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ca279a_a264_44bc_b405_6ab87672b286.slice/crio-617e986dcc9c6483e73a674573acc0964c24865fb15e977cc94994b7f3fb3860 WatchSource:0}: Error finding container 617e986dcc9c6483e73a674573acc0964c24865fb15e977cc94994b7f3fb3860: Status 404 returned error can't find the container with id 617e986dcc9c6483e73a674573acc0964c24865fb15e977cc94994b7f3fb3860 Jul 29 19:18:11.126860 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:11.126829 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lzdtw" Jul 29 19:18:11.167776 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:11.167697 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvjdl" event={"ID":"d147b8c7-251a-4c9d-aef7-35016719e787","Type":"ContainerStarted","Data":"bb5fcb6f8f7f6286806be5bb560179c7b1e39a8481160721ebb298f168fcef77"} Jul 29 19:18:11.168992 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:11.168964 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-grl5c" event={"ID":"5c69d0c5-b5bd-4bf5-9c22-70c9d5bce5e7","Type":"ContainerStarted","Data":"9cf390818015a23054ad7e49d4addcc0735804e3b0780e86eaaec0bd4bf9fcc1"} Jul 29 19:18:11.170797 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:11.170769 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bb4465977-m9lgt" event={"ID":"c6ca279a-a264-44bc-b405-6ab87672b286","Type":"ContainerStarted","Data":"5b4a7150a0e288aa913b90e752cea29efc5c099c3823296b3d93c3d5fc4dd16c"} Jul 29 19:18:11.170913 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:11.170812 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bb4465977-m9lgt" event={"ID":"c6ca279a-a264-44bc-b405-6ab87672b286","Type":"ContainerStarted","Data":"617e986dcc9c6483e73a674573acc0964c24865fb15e977cc94994b7f3fb3860"} Jul 29 19:18:11.172136 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:11.172110 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" event={"ID":"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa","Type":"ContainerStarted","Data":"d01b47c60ec02bc7021542e0cbf6944bcc775bace845e87e5522f78444eefc49"} Jul 29 19:18:11.192928 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:11.192867 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7bb4465977-m9lgt" podStartSLOduration=35.192843532 podStartE2EDuration="35.192843532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:11.191090539 +0000 UTC m=+81.079397766" watchObservedRunningTime="2026-07-29 19:18:11.192843532 +0000 UTC m=+81.081150761" Jul 29 19:18:11.236528 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:11.236478 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:18:11.240249 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:11.240221 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:18:11.971584 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:11.971549 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:12.068184 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:12.068138 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:12.180564 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:12.180021 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:18:12.182627 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:12.181385 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7bb4465977-m9lgt" Jul 29 19:18:13.185929 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:13.185883 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" event={"ID":"a7ee0f3b-4ae1-4005-a5ae-cca1527207aa","Type":"ContainerStarted","Data":"3280b6d80acfa6ebd54a5225a7d8a341c6788fd4b47e4424072c9b3011bac95a"} Jul 29 19:18:13.458249 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:13.457664 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:13.625318 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:13.625281 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:13.829749 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:13.829633 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:13.889999 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:13.889873 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:14.209523 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:14.209442 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-q7tkb" podStartSLOduration=35.717021785 podStartE2EDuration="38.209417122s" totalImagesPullingTime="2.492395337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:14.207195627 +0000 UTC m=+84.095502876" watchObservedRunningTime="2026-07-29 19:18:14.209417122 +0000 UTC m=+84.097724350" Jul 29 19:18:14.388488 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:14.388438 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:14.497501 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:14.497378 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:14.555534 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:14.555415 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:15.533679 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:15.533600 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:16.147589 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:16.147539 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:16.201655 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:16.201621 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvjdl" event={"ID":"d147b8c7-251a-4c9d-aef7-35016719e787","Type":"ContainerStarted","Data":"23a5deb59d9945dd0bce877161ad5dc028a19de0e58902948251379190782b64"} Jul 29 19:18:16.220353 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:16.220308 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vvjdl" podStartSLOduration=17.966247558 podStartE2EDuration="32.220284958s" totalImagesPullingTime="14.2540374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 19:17:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:16.219679736 +0000 UTC m=+86.107986962" watchObservedRunningTime="2026-07-29 19:18:16.220284958 +0000 UTC m=+86.108592185" Jul 29 19:18:16.662676 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:16.662641 2574 patch_prober.go:28] interesting pod/image-registry-6cfcf6c44b-wkzcc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 29 19:18:16.663082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:16.662708 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" podUID="a108a15f-f888-4215-8577-c0e957166d20" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 19:18:17.158550 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:17.158493 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:17.220050 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:17.219995 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:18.103600 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:18.103569 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:18:18.288876 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:18.288775 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:18.362035 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:18.361947 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:18.666357 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:18.666301 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:18.768201 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:18.768164 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:18.828496 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:18.828459 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:19.248456 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:19.248417 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:20.344338 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:20.344288 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:21.133448 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:21.133411 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:21.233934 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:21.233901 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:25.355284 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:25.355245 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:25.532837 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:25.532798 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:25.635203 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:25.635169 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:25.732741 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:25.732696 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:26.192648 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:26.192609 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:26.698168 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:26.698080 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:26.817948 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:26.817913 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:27.035353 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.035200 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:27.108696 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.108087 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c78qc"] Jul 29 19:18:27.125498 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.125458 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:27.190938 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.190908 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.193060 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.193037 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 19:18:27.193669 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.193649 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 19:18:27.193777 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.193676 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bcfpk\"" Jul 29 19:18:27.193777 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.193759 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 19:18:27.194130 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.194108 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 19:18:27.200975 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.200903 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f771a0b6-5756-46e1-91ee-ee418a8d4d30-node-exporter-tls\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.201201 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.201177 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f771a0b6-5756-46e1-91ee-ee418a8d4d30-node-exporter-textfile\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.201280 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.201240 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f771a0b6-5756-46e1-91ee-ee418a8d4d30-root\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.201445 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.201286 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f771a0b6-5756-46e1-91ee-ee418a8d4d30-sys\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.201668 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.201466 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f771a0b6-5756-46e1-91ee-ee418a8d4d30-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.201789 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.201672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pfqg\" (UniqueName: \"kubernetes.io/projected/f771a0b6-5756-46e1-91ee-ee418a8d4d30-kube-api-access-5pfqg\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.202007 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.201844 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f771a0b6-5756-46e1-91ee-ee418a8d4d30-node-exporter-accelerators-collector-config\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.202070 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.202020 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f771a0b6-5756-46e1-91ee-ee418a8d4d30-metrics-client-ca\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.202189 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.202175 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f771a0b6-5756-46e1-91ee-ee418a8d4d30-node-exporter-wtmp\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.303710 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.303625 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f771a0b6-5756-46e1-91ee-ee418a8d4d30-sys\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.303710 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.303659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f771a0b6-5756-46e1-91ee-ee418a8d4d30-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.303710 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.303677 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pfqg\" (UniqueName: \"kubernetes.io/projected/f771a0b6-5756-46e1-91ee-ee418a8d4d30-kube-api-access-5pfqg\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.303998 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.303830 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f771a0b6-5756-46e1-91ee-ee418a8d4d30-sys\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.303998 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.303876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f771a0b6-5756-46e1-91ee-ee418a8d4d30-node-exporter-accelerators-collector-config\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.303998 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.303923 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f771a0b6-5756-46e1-91ee-ee418a8d4d30-metrics-client-ca\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.303998 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.303958 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f771a0b6-5756-46e1-91ee-ee418a8d4d30-node-exporter-wtmp\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.304198 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.303999 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f771a0b6-5756-46e1-91ee-ee418a8d4d30-node-exporter-tls\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.304198 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.304061 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f771a0b6-5756-46e1-91ee-ee418a8d4d30-node-exporter-textfile\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.304198 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.304097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f771a0b6-5756-46e1-91ee-ee418a8d4d30-root\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.304198 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.304187 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f771a0b6-5756-46e1-91ee-ee418a8d4d30-root\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.304472 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.304450 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f771a0b6-5756-46e1-91ee-ee418a8d4d30-node-exporter-textfile\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.304576 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.304552 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f771a0b6-5756-46e1-91ee-ee418a8d4d30-node-exporter-accelerators-collector-config\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.304632 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.304616 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f771a0b6-5756-46e1-91ee-ee418a8d4d30-node-exporter-wtmp\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.304692 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.304617 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f771a0b6-5756-46e1-91ee-ee418a8d4d30-metrics-client-ca\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.306550 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.306504 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f771a0b6-5756-46e1-91ee-ee418a8d4d30-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.306892 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.306864 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f771a0b6-5756-46e1-91ee-ee418a8d4d30-node-exporter-tls\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.313210 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.313187 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pfqg\" (UniqueName: \"kubernetes.io/projected/f771a0b6-5756-46e1-91ee-ee418a8d4d30-kube-api-access-5pfqg\") pod \"node-exporter-c78qc\" (UID: \"f771a0b6-5756-46e1-91ee-ee418a8d4d30\") " pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.405369 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.405325 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:27.492330 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.492292 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:27.508772 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.508744 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c78qc" Jul 29 19:18:27.765415 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.765367 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:27.866051 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.866019 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:27.966664 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:27.966626 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:28.085272 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:28.085178 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:28.100985 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:28.100958 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9gg2k" Jul 29 19:18:28.187253 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:28.187169 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:28.285891 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:28.285838 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:28.356545 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:18:28.356501 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf771a0b6_5756_46e1_91ee_ee418a8d4d30.slice/crio-527088f64c84dbc9a89ebd5639efe3d807c4b5709b26862e568246e6b38a4ac0 WatchSource:0}: Error finding container 527088f64c84dbc9a89ebd5639efe3d807c4b5709b26862e568246e6b38a4ac0: Status 404 returned error can't find the container with id 527088f64c84dbc9a89ebd5639efe3d807c4b5709b26862e568246e6b38a4ac0 Jul 29 19:18:28.586762 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:28.586736 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:28.660744 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:28.660716 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:29.131165 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:29.131001 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:29.209574 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:29.209539 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:29.257731 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:29.257458 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-grl5c" event={"ID":"5c69d0c5-b5bd-4bf5-9c22-70c9d5bce5e7","Type":"ContainerStarted","Data":"50c520521d67c02533f09f8da89a708ea2e50862c7ccf107360aee51156b0bc4"} Jul 29 19:18:29.257951 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:29.257818 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-grl5c" Jul 29 19:18:29.260186 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:29.259733 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c78qc" event={"ID":"f771a0b6-5756-46e1-91ee-ee418a8d4d30","Type":"ContainerStarted","Data":"527088f64c84dbc9a89ebd5639efe3d807c4b5709b26862e568246e6b38a4ac0"} Jul 29 19:18:29.271247 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:29.271217 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-grl5c" Jul 29 19:18:29.279563 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:29.279497 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-grl5c" podStartSLOduration=1.889324271 podStartE2EDuration="20.279483152s" totalImagesPullingTime="18.390158881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:29.278862611 +0000 UTC m=+99.167169839" watchObservedRunningTime="2026-07-29 19:18:29.279483152 +0000 UTC m=+99.167790379" Jul 29 19:18:30.077710 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:30.077669 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:30.178889 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:30.178846 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:30.266544 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:30.266490 2574 generic.go:356] "Generic (PLEG): container finished" podID="f771a0b6-5756-46e1-91ee-ee418a8d4d30" containerID="05f554b330e0343f3cc2141b585116e25d9e3d874dd4e512d206044770f32701" exitCode=0 Jul 29 19:18:30.266720 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:30.266547 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c78qc" event={"ID":"f771a0b6-5756-46e1-91ee-ee418a8d4d30","Type":"ContainerDied","Data":"05f554b330e0343f3cc2141b585116e25d9e3d874dd4e512d206044770f32701"} Jul 29 19:18:30.294115 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:30.294082 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:30.382346 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:30.382307 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:31.273521 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:31.273462 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c78qc" event={"ID":"f771a0b6-5756-46e1-91ee-ee418a8d4d30","Type":"ContainerStarted","Data":"dd0b86321ca7f1de410a05dbb4b5d395b7ae962c08d44d4f5351442ec206d2a9"} Jul 29 19:18:31.273987 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:31.273539 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c78qc" event={"ID":"f771a0b6-5756-46e1-91ee-ee418a8d4d30","Type":"ContainerStarted","Data":"f488b6ca7b3fb5831f396d561a2177e646da75f854b723cb2c0e9fda6478034e"} Jul 29 19:18:31.292710 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:31.292644 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c78qc" podStartSLOduration=2.563873907 podStartE2EDuration="4.292627074s" totalImagesPullingTime="1.613025442s" totalInitContainerRuntime="115.727725ms" isStatefulPod=true podCreationTimestamp="2026-07-29 19:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:18:31.291786804 +0000 UTC m=+101.180094032" watchObservedRunningTime="2026-07-29 19:18:31.292627074 +0000 UTC m=+101.180934354" Jul 29 19:18:31.889092 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:31.889048 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:31.951345 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:31.951308 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:32.043670 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:32.043626 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:32.145185 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:32.145092 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:33.474222 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:33.474183 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:33.516153 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:33.516120 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cfcf6c44b-wkzcc"] Jul 29 19:18:33.551502 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:33.551466 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:33.628128 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:33.628092 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:33.715565 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:33.715524 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:34.147974 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:34.147927 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:34.249345 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:34.249300 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:37.633610 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:37.633562 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:42.200124 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:42.200093 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:42.264693 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:42.264661 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:42.848228 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:42.848197 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:42.948458 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:42.948416 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:43.048876 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:43.048837 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:46.650837 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:46.650797 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:46.751104 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:46.751065 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:49.115068 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:49.114970 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:49.169381 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:49.169349 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:49.345709 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:49.345675 2574 generic.go:356] "Generic (PLEG): container finished" podID="00daf99c-cd3c-4ce7-907c-d03b8d0f7325" containerID="56906afafce7df566fbf0cbc4d4d22fa72e4929517e2ec51515392e802387667" exitCode=0 Jul 29 19:18:49.345877 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:49.345722 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v" event={"ID":"00daf99c-cd3c-4ce7-907c-d03b8d0f7325","Type":"ContainerDied","Data":"56906afafce7df566fbf0cbc4d4d22fa72e4929517e2ec51515392e802387667"} Jul 29 19:18:49.346027 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:49.346013 2574 scope.go:117] "RemoveContainer" containerID="56906afafce7df566fbf0cbc4d4d22fa72e4929517e2ec51515392e802387667" Jul 29 19:18:50.351237 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:50.351201 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v" event={"ID":"00daf99c-cd3c-4ce7-907c-d03b8d0f7325","Type":"ContainerStarted","Data":"248deb35955b974abe8cafcfd695d69444d491c93e2d62058b0d2efb67f4a8f1"} Jul 29 19:18:55.812560 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:55.812503 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:55.917379 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:55.917346 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:55.973597 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:55.973557 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:18:58.538711 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.538671 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" podUID="a108a15f-f888-4215-8577-c0e957166d20" containerName="registry" containerID="cri-o://dcae01d1b228303a4fbd03c72c945e5eea9ed7a2f1f2cf606db32e11f94c2f62" gracePeriod=30 Jul 29 19:18:58.833171 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.833145 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:18:58.967591 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.967560 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a108a15f-f888-4215-8577-c0e957166d20-ca-trust-extracted\") pod \"a108a15f-f888-4215-8577-c0e957166d20\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " Jul 29 19:18:58.967765 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.967609 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a108a15f-f888-4215-8577-c0e957166d20-registry-certificates\") pod \"a108a15f-f888-4215-8577-c0e957166d20\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " Jul 29 19:18:58.967765 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.967629 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a108a15f-f888-4215-8577-c0e957166d20-image-registry-private-configuration\") pod \"a108a15f-f888-4215-8577-c0e957166d20\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " Jul 29 19:18:58.967765 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.967646 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a108a15f-f888-4215-8577-c0e957166d20-installation-pull-secrets\") pod \"a108a15f-f888-4215-8577-c0e957166d20\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " Jul 29 19:18:58.967765 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.967662 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls\") pod \"a108a15f-f888-4215-8577-c0e957166d20\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " Jul 29 19:18:58.967765 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.967679 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a108a15f-f888-4215-8577-c0e957166d20-trusted-ca\") pod \"a108a15f-f888-4215-8577-c0e957166d20\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " Jul 29 19:18:58.967765 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.967707 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-bound-sa-token\") pod \"a108a15f-f888-4215-8577-c0e957166d20\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " Jul 29 19:18:58.967765 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.967725 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bpmq\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-kube-api-access-6bpmq\") pod \"a108a15f-f888-4215-8577-c0e957166d20\" (UID: \"a108a15f-f888-4215-8577-c0e957166d20\") " Jul 29 19:18:58.968128 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.968016 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a108a15f-f888-4215-8577-c0e957166d20-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a108a15f-f888-4215-8577-c0e957166d20" (UID: "a108a15f-f888-4215-8577-c0e957166d20"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 19:18:58.968412 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.968376 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a108a15f-f888-4215-8577-c0e957166d20-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a108a15f-f888-4215-8577-c0e957166d20" (UID: "a108a15f-f888-4215-8577-c0e957166d20"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 19:18:58.970273 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.970242 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a108a15f-f888-4215-8577-c0e957166d20-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a108a15f-f888-4215-8577-c0e957166d20" (UID: "a108a15f-f888-4215-8577-c0e957166d20"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 19:18:58.970424 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.970404 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a108a15f-f888-4215-8577-c0e957166d20" (UID: "a108a15f-f888-4215-8577-c0e957166d20"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:18:58.970538 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.970429 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a108a15f-f888-4215-8577-c0e957166d20-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a108a15f-f888-4215-8577-c0e957166d20" (UID: "a108a15f-f888-4215-8577-c0e957166d20"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 19:18:58.970538 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.970477 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a108a15f-f888-4215-8577-c0e957166d20" (UID: "a108a15f-f888-4215-8577-c0e957166d20"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:18:58.970648 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.970564 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-kube-api-access-6bpmq" (OuterVolumeSpecName: "kube-api-access-6bpmq") pod "a108a15f-f888-4215-8577-c0e957166d20" (UID: "a108a15f-f888-4215-8577-c0e957166d20"). InnerVolumeSpecName "kube-api-access-6bpmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:18:58.977722 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:58.977700 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a108a15f-f888-4215-8577-c0e957166d20-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a108a15f-f888-4215-8577-c0e957166d20" (UID: "a108a15f-f888-4215-8577-c0e957166d20"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:18:59.069159 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.069086 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a108a15f-f888-4215-8577-c0e957166d20-ca-trust-extracted\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:18:59.069159 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.069113 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a108a15f-f888-4215-8577-c0e957166d20-registry-certificates\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:18:59.069159 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.069123 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a108a15f-f888-4215-8577-c0e957166d20-image-registry-private-configuration\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:18:59.069159 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.069133 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a108a15f-f888-4215-8577-c0e957166d20-installation-pull-secrets\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:18:59.069159 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.069141 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-registry-tls\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:18:59.069159 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.069151 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a108a15f-f888-4215-8577-c0e957166d20-trusted-ca\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:18:59.069159 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.069159 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-bound-sa-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:18:59.069159 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.069166 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bpmq\" (UniqueName: \"kubernetes.io/projected/a108a15f-f888-4215-8577-c0e957166d20-kube-api-access-6bpmq\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:18:59.384744 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.384715 2574 generic.go:356] "Generic (PLEG): container finished" podID="a108a15f-f888-4215-8577-c0e957166d20" containerID="dcae01d1b228303a4fbd03c72c945e5eea9ed7a2f1f2cf606db32e11f94c2f62" exitCode=0 Jul 29 19:18:59.384903 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.384756 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" Jul 29 19:18:59.384903 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.384756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" event={"ID":"a108a15f-f888-4215-8577-c0e957166d20","Type":"ContainerDied","Data":"dcae01d1b228303a4fbd03c72c945e5eea9ed7a2f1f2cf606db32e11f94c2f62"} Jul 29 19:18:59.384903 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.384876 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cfcf6c44b-wkzcc" event={"ID":"a108a15f-f888-4215-8577-c0e957166d20","Type":"ContainerDied","Data":"5e127af8bec6c5cf25d39d0433603fb244fd2e098ab4a5f609bdc81da18cdd83"} Jul 29 19:18:59.384903 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.384903 2574 scope.go:117] "RemoveContainer" containerID="dcae01d1b228303a4fbd03c72c945e5eea9ed7a2f1f2cf606db32e11f94c2f62" Jul 29 19:18:59.396585 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.396549 2574 scope.go:117] "RemoveContainer" containerID="dcae01d1b228303a4fbd03c72c945e5eea9ed7a2f1f2cf606db32e11f94c2f62" Jul 29 19:18:59.396892 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:18:59.396870 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcae01d1b228303a4fbd03c72c945e5eea9ed7a2f1f2cf606db32e11f94c2f62\": container with ID starting with dcae01d1b228303a4fbd03c72c945e5eea9ed7a2f1f2cf606db32e11f94c2f62 not found: ID does not exist" containerID="dcae01d1b228303a4fbd03c72c945e5eea9ed7a2f1f2cf606db32e11f94c2f62" Jul 29 19:18:59.396975 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.396898 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcae01d1b228303a4fbd03c72c945e5eea9ed7a2f1f2cf606db32e11f94c2f62"} err="failed to get container status \"dcae01d1b228303a4fbd03c72c945e5eea9ed7a2f1f2cf606db32e11f94c2f62\": rpc error: code = NotFound desc = could not find container \"dcae01d1b228303a4fbd03c72c945e5eea9ed7a2f1f2cf606db32e11f94c2f62\": container with ID starting with dcae01d1b228303a4fbd03c72c945e5eea9ed7a2f1f2cf606db32e11f94c2f62 not found: ID does not exist" Jul 29 19:18:59.407946 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.407919 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cfcf6c44b-wkzcc"] Jul 29 19:18:59.409805 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:18:59.409785 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6cfcf6c44b-wkzcc"] Jul 29 19:19:00.733739 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:00.733704 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a108a15f-f888-4215-8577-c0e957166d20" path="/var/lib/kubelet/pods/a108a15f-f888-4215-8577-c0e957166d20/volumes" Jul 29 19:19:05.408341 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:05.408301 2574 generic.go:356] "Generic (PLEG): container finished" podID="bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78" containerID="2d6c3d1c94c7b7ed2239093048295383a2330058c4195673139557a8ceb925f2" exitCode=0 Jul 29 19:19:05.408782 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:05.408376 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-8hgcl" event={"ID":"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78","Type":"ContainerDied","Data":"2d6c3d1c94c7b7ed2239093048295383a2330058c4195673139557a8ceb925f2"} Jul 29 19:19:05.408782 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:05.408728 2574 scope.go:117] "RemoveContainer" containerID="2d6c3d1c94c7b7ed2239093048295383a2330058c4195673139557a8ceb925f2" Jul 29 19:19:06.413948 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:06.413915 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-8hgcl" event={"ID":"bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78","Type":"ContainerStarted","Data":"baa141de4fe1c9810ca67398196e70467cebd1d161fd75a67ae9a37a2054dee3"} Jul 29 19:19:14.449104 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:14.449069 2574 generic.go:356] "Generic (PLEG): container finished" podID="43a9ff3e-13e7-4098-b729-711de6048162" containerID="8c90b9902eb9e760fd4cc22974bda5844fc4c646dffc9e2f1c7dc00357d7b258" exitCode=0 Jul 29 19:19:14.449571 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:14.449112 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl" event={"ID":"43a9ff3e-13e7-4098-b729-711de6048162","Type":"ContainerDied","Data":"8c90b9902eb9e760fd4cc22974bda5844fc4c646dffc9e2f1c7dc00357d7b258"} Jul 29 19:19:14.449571 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:14.449460 2574 scope.go:117] "RemoveContainer" containerID="8c90b9902eb9e760fd4cc22974bda5844fc4c646dffc9e2f1c7dc00357d7b258" Jul 29 19:19:15.454671 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:15.454637 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-48ltl" event={"ID":"43a9ff3e-13e7-4098-b729-711de6048162","Type":"ContainerStarted","Data":"2be34752aa1cf5f3f7b7a2139cc1851a5a9037b4dd4b01a892d8c39393bed99b"} Jul 29 19:19:46.407836 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:46.407746 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:19:47.118205 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:47.118169 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:19:51.498745 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.498703 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-56c78d9db4-cp2bf"] Jul 29 19:19:51.499172 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.499021 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a108a15f-f888-4215-8577-c0e957166d20" containerName="registry" Jul 29 19:19:51.499172 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.499034 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a108a15f-f888-4215-8577-c0e957166d20" containerName="registry" Jul 29 19:19:51.499172 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.499089 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a108a15f-f888-4215-8577-c0e957166d20" containerName="registry" Jul 29 19:19:51.502017 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.501987 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.504425 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.504382 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 29 19:19:51.504574 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.504451 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-j8c6m\"" Jul 29 19:19:51.504637 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.504570 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 29 19:19:51.504637 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.504557 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 29 19:19:51.504732 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.504630 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 29 19:19:51.504732 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.504691 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 29 19:19:51.510766 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.510744 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 29 19:19:51.515988 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.515964 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56c78d9db4-cp2bf"] Jul 29 19:19:51.582678 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.582632 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38047098-efbd-4c35-b876-dafe7517d3c5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.582678 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.582681 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/38047098-efbd-4c35-b876-dafe7517d3c5-telemeter-client-tls\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.582901 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.582714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/38047098-efbd-4c35-b876-dafe7517d3c5-federate-client-tls\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.582901 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.582784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38047098-efbd-4c35-b876-dafe7517d3c5-metrics-client-ca\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.582901 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.582829 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/38047098-efbd-4c35-b876-dafe7517d3c5-secret-telemeter-client\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.582901 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.582850 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38047098-efbd-4c35-b876-dafe7517d3c5-serving-certs-ca-bundle\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.582901 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.582896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9mb5\" (UniqueName: \"kubernetes.io/projected/38047098-efbd-4c35-b876-dafe7517d3c5-kube-api-access-l9mb5\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.583080 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.582965 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38047098-efbd-4c35-b876-dafe7517d3c5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.684323 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.684284 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9mb5\" (UniqueName: \"kubernetes.io/projected/38047098-efbd-4c35-b876-dafe7517d3c5-kube-api-access-l9mb5\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.684686 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.684345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38047098-efbd-4c35-b876-dafe7517d3c5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.684686 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.684475 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38047098-efbd-4c35-b876-dafe7517d3c5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.684686 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.684542 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/38047098-efbd-4c35-b876-dafe7517d3c5-telemeter-client-tls\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.684686 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.684569 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/38047098-efbd-4c35-b876-dafe7517d3c5-federate-client-tls\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.684686 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.684587 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38047098-efbd-4c35-b876-dafe7517d3c5-metrics-client-ca\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.684686 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.684610 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/38047098-efbd-4c35-b876-dafe7517d3c5-secret-telemeter-client\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.684686 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.684630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38047098-efbd-4c35-b876-dafe7517d3c5-serving-certs-ca-bundle\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.685399 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.685347 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38047098-efbd-4c35-b876-dafe7517d3c5-metrics-client-ca\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.685399 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.685369 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38047098-efbd-4c35-b876-dafe7517d3c5-serving-certs-ca-bundle\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.685399 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.685390 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38047098-efbd-4c35-b876-dafe7517d3c5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.687163 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.687141 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/38047098-efbd-4c35-b876-dafe7517d3c5-federate-client-tls\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.687399 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.687379 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/38047098-efbd-4c35-b876-dafe7517d3c5-secret-telemeter-client\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.687449 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.687409 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38047098-efbd-4c35-b876-dafe7517d3c5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.687449 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.687428 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/38047098-efbd-4c35-b876-dafe7517d3c5-telemeter-client-tls\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.691876 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.691853 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9mb5\" (UniqueName: \"kubernetes.io/projected/38047098-efbd-4c35-b876-dafe7517d3c5-kube-api-access-l9mb5\") pod \"telemeter-client-56c78d9db4-cp2bf\" (UID: \"38047098-efbd-4c35-b876-dafe7517d3c5\") " pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.813040 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.812943 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" Jul 29 19:19:51.948038 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:51.948011 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56c78d9db4-cp2bf"] Jul 29 19:19:51.950795 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:19:51.950764 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38047098_efbd_4c35_b876_dafe7517d3c5.slice/crio-e8f4f03c1be7cdd5a642dffacb9fb16db9b79dbf1284f73254b38579b11c9c50 WatchSource:0}: Error finding container e8f4f03c1be7cdd5a642dffacb9fb16db9b79dbf1284f73254b38579b11c9c50: Status 404 returned error can't find the container with id e8f4f03c1be7cdd5a642dffacb9fb16db9b79dbf1284f73254b38579b11c9c50 Jul 29 19:19:52.593946 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:52.593903 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" event={"ID":"38047098-efbd-4c35-b876-dafe7517d3c5","Type":"ContainerStarted","Data":"e8f4f03c1be7cdd5a642dffacb9fb16db9b79dbf1284f73254b38579b11c9c50"} Jul 29 19:19:54.604361 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:54.604325 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" event={"ID":"38047098-efbd-4c35-b876-dafe7517d3c5","Type":"ContainerStarted","Data":"e26fe8a3286031e14b6ca711ece304175705d66cc2005a54e1f13c40292a3212"} Jul 29 19:19:55.610038 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:55.609997 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" event={"ID":"38047098-efbd-4c35-b876-dafe7517d3c5","Type":"ContainerStarted","Data":"41ff136b6b92f1bfbb14414b7e8149ca557f70074581bf4a627c55140173b783"} Jul 29 19:19:55.610448 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:55.610064 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" event={"ID":"38047098-efbd-4c35-b876-dafe7517d3c5","Type":"ContainerStarted","Data":"d4c69adf3d0f05a18013e7ab76e322d245f96ad19175a82abac8732a0c18d5ee"} Jul 29 19:19:55.634405 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:55.634355 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-56c78d9db4-cp2bf" podStartSLOduration=1.804244238 podStartE2EDuration="4.634337s" totalImagesPullingTime="2.830092762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:19:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:19:55.632716733 +0000 UTC m=+185.521023980" watchObservedRunningTime="2026-07-29 19:19:55.634337 +0000 UTC m=+185.522644229" Jul 29 19:19:56.438192 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:56.438141 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:19:56.540026 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:19:56.539985 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:20:07.284821 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:20:07.284783 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:20:07.385076 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:20:07.385036 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:20:07.440557 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:20:07.440505 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:20:36.307656 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:20:36.307611 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:20:36.361580 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:20:36.361527 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:20:58.585441 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:20:58.585399 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:21:01.649984 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:01.649943 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:21:01.753395 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:01.753338 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:21:13.656826 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:13.656705 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:21:13.758064 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:13.758006 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:21:16.377912 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:16.377862 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:21:19.073952 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:19.073920 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:21:19.175119 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:19.175064 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:21:19.229098 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:19.229060 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:21:27.578063 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:27.578026 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:21:27.677181 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:27.677129 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:21:27.777070 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:27.777032 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:21:33.114200 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:33.114160 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:21:50.375500 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:50.375458 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:21:50.493299 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:50.493269 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:21:50.496652 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:50.496630 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:21:50.499680 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:50.499659 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:21:50.502655 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:50.502634 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:21:50.504304 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:50.504289 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 19:21:51.290689 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:51.290652 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:21:51.385891 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:51.385860 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:21:51.921106 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:51.921070 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk"] Jul 29 19:21:51.923456 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:51.923438 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" Jul 29 19:21:51.925502 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:51.925480 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 19:21:51.925651 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:51.925499 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 19:21:51.925984 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:51.925963 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kgmlm\"" Jul 29 19:21:51.932334 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:51.932310 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk"] Jul 29 19:21:52.028380 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:52.028334 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59rt4\" (UniqueName: \"kubernetes.io/projected/96ee852d-027f-49c9-a52f-be5253f944fc-kube-api-access-59rt4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk\" (UID: \"96ee852d-027f-49c9-a52f-be5253f944fc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" Jul 29 19:21:52.028380 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:52.028381 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96ee852d-027f-49c9-a52f-be5253f944fc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk\" (UID: \"96ee852d-027f-49c9-a52f-be5253f944fc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" Jul 29 19:21:52.028691 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:52.028496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96ee852d-027f-49c9-a52f-be5253f944fc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk\" (UID: \"96ee852d-027f-49c9-a52f-be5253f944fc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" Jul 29 19:21:52.129219 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:52.129176 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59rt4\" (UniqueName: \"kubernetes.io/projected/96ee852d-027f-49c9-a52f-be5253f944fc-kube-api-access-59rt4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk\" (UID: \"96ee852d-027f-49c9-a52f-be5253f944fc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" Jul 29 19:21:52.129219 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:52.129218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96ee852d-027f-49c9-a52f-be5253f944fc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk\" (UID: \"96ee852d-027f-49c9-a52f-be5253f944fc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" Jul 29 19:21:52.129467 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:52.129271 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96ee852d-027f-49c9-a52f-be5253f944fc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk\" (UID: \"96ee852d-027f-49c9-a52f-be5253f944fc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" Jul 29 19:21:52.129663 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:52.129643 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96ee852d-027f-49c9-a52f-be5253f944fc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk\" (UID: \"96ee852d-027f-49c9-a52f-be5253f944fc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" Jul 29 19:21:52.129750 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:52.129724 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96ee852d-027f-49c9-a52f-be5253f944fc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk\" (UID: \"96ee852d-027f-49c9-a52f-be5253f944fc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" Jul 29 19:21:52.139085 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:52.139056 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59rt4\" (UniqueName: \"kubernetes.io/projected/96ee852d-027f-49c9-a52f-be5253f944fc-kube-api-access-59rt4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk\" (UID: \"96ee852d-027f-49c9-a52f-be5253f944fc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" Jul 29 19:21:52.234067 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:52.233964 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" Jul 29 19:21:52.363613 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:52.363400 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk"] Jul 29 19:21:52.366283 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:21:52.366256 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ee852d_027f_49c9_a52f_be5253f944fc.slice/crio-a831ef0d10bf207200c49efb8174ea56f82b81e4bac54a0e91cb8456cba757e7 WatchSource:0}: Error finding container a831ef0d10bf207200c49efb8174ea56f82b81e4bac54a0e91cb8456cba757e7: Status 404 returned error can't find the container with id a831ef0d10bf207200c49efb8174ea56f82b81e4bac54a0e91cb8456cba757e7 Jul 29 19:21:52.368222 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:52.368206 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 19:21:53.060823 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:53.060789 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" event={"ID":"96ee852d-027f-49c9-a52f-be5253f944fc","Type":"ContainerStarted","Data":"a831ef0d10bf207200c49efb8174ea56f82b81e4bac54a0e91cb8456cba757e7"} Jul 29 19:21:59.085935 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:59.085843 2574 generic.go:356] "Generic (PLEG): container finished" podID="96ee852d-027f-49c9-a52f-be5253f944fc" containerID="fc52b284b2c28bea53f42881b05edae72bcb49016415a7a15f9506e9f65227ab" exitCode=0 Jul 29 19:21:59.085935 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:21:59.085893 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" event={"ID":"96ee852d-027f-49c9-a52f-be5253f944fc","Type":"ContainerDied","Data":"fc52b284b2c28bea53f42881b05edae72bcb49016415a7a15f9506e9f65227ab"} Jul 29 19:22:01.095046 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:01.094953 2574 generic.go:356] "Generic (PLEG): container finished" podID="96ee852d-027f-49c9-a52f-be5253f944fc" containerID="7c3d1728cc2be1c797d94ece24723f62345e9cd7efa593fca4a1f224546f0bd9" exitCode=0 Jul 29 19:22:01.095467 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:01.095042 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" event={"ID":"96ee852d-027f-49c9-a52f-be5253f944fc","Type":"ContainerDied","Data":"7c3d1728cc2be1c797d94ece24723f62345e9cd7efa593fca4a1f224546f0bd9"} Jul 29 19:22:08.128184 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:08.128147 2574 generic.go:356] "Generic (PLEG): container finished" podID="96ee852d-027f-49c9-a52f-be5253f944fc" containerID="f955e878507d66cac943aa7b91771cf85926459e207fae0b6bdbbd76c8ab3207" exitCode=0 Jul 29 19:22:08.128621 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:08.128201 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" event={"ID":"96ee852d-027f-49c9-a52f-be5253f944fc","Type":"ContainerDied","Data":"f955e878507d66cac943aa7b91771cf85926459e207fae0b6bdbbd76c8ab3207"} Jul 29 19:22:09.257041 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:09.257016 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" Jul 29 19:22:09.375845 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:09.375805 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59rt4\" (UniqueName: \"kubernetes.io/projected/96ee852d-027f-49c9-a52f-be5253f944fc-kube-api-access-59rt4\") pod \"96ee852d-027f-49c9-a52f-be5253f944fc\" (UID: \"96ee852d-027f-49c9-a52f-be5253f944fc\") " Jul 29 19:22:09.376022 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:09.375882 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96ee852d-027f-49c9-a52f-be5253f944fc-bundle\") pod \"96ee852d-027f-49c9-a52f-be5253f944fc\" (UID: \"96ee852d-027f-49c9-a52f-be5253f944fc\") " Jul 29 19:22:09.376022 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:09.375919 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96ee852d-027f-49c9-a52f-be5253f944fc-util\") pod \"96ee852d-027f-49c9-a52f-be5253f944fc\" (UID: \"96ee852d-027f-49c9-a52f-be5253f944fc\") " Jul 29 19:22:09.376539 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:09.376481 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96ee852d-027f-49c9-a52f-be5253f944fc-bundle" (OuterVolumeSpecName: "bundle") pod "96ee852d-027f-49c9-a52f-be5253f944fc" (UID: "96ee852d-027f-49c9-a52f-be5253f944fc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:22:09.378052 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:09.378028 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96ee852d-027f-49c9-a52f-be5253f944fc-kube-api-access-59rt4" (OuterVolumeSpecName: "kube-api-access-59rt4") pod "96ee852d-027f-49c9-a52f-be5253f944fc" (UID: "96ee852d-027f-49c9-a52f-be5253f944fc"). InnerVolumeSpecName "kube-api-access-59rt4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:22:09.380704 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:09.380684 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96ee852d-027f-49c9-a52f-be5253f944fc-util" (OuterVolumeSpecName: "util") pod "96ee852d-027f-49c9-a52f-be5253f944fc" (UID: "96ee852d-027f-49c9-a52f-be5253f944fc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:22:09.477386 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:09.477345 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96ee852d-027f-49c9-a52f-be5253f944fc-util\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:22:09.477386 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:09.477375 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59rt4\" (UniqueName: \"kubernetes.io/projected/96ee852d-027f-49c9-a52f-be5253f944fc-kube-api-access-59rt4\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:22:09.477386 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:09.477387 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96ee852d-027f-49c9-a52f-be5253f944fc-bundle\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:22:10.137526 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:10.137492 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" Jul 29 19:22:10.137715 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:10.137520 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rq7jk" event={"ID":"96ee852d-027f-49c9-a52f-be5253f944fc","Type":"ContainerDied","Data":"a831ef0d10bf207200c49efb8174ea56f82b81e4bac54a0e91cb8456cba757e7"} Jul 29 19:22:10.137715 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:10.137577 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a831ef0d10bf207200c49efb8174ea56f82b81e4bac54a0e91cb8456cba757e7" Jul 29 19:22:12.934430 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:12.934380 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:14.209819 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:14.209768 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:15.050095 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.050044 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8s7hd"] Jul 29 19:22:15.050424 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.050405 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96ee852d-027f-49c9-a52f-be5253f944fc" containerName="extract" Jul 29 19:22:15.050505 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.050426 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="96ee852d-027f-49c9-a52f-be5253f944fc" containerName="extract" Jul 29 19:22:15.050505 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.050456 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96ee852d-027f-49c9-a52f-be5253f944fc" containerName="util" Jul 29 19:22:15.050505 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.050465 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="96ee852d-027f-49c9-a52f-be5253f944fc" containerName="util" Jul 29 19:22:15.050505 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.050479 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96ee852d-027f-49c9-a52f-be5253f944fc" containerName="pull" Jul 29 19:22:15.050505 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.050488 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="96ee852d-027f-49c9-a52f-be5253f944fc" containerName="pull" Jul 29 19:22:15.050762 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.050585 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="96ee852d-027f-49c9-a52f-be5253f944fc" containerName="extract" Jul 29 19:22:15.103212 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.103124 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8s7hd"] Jul 29 19:22:15.103423 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.103235 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8s7hd" Jul 29 19:22:15.105657 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.105632 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 29 19:22:15.105800 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.105665 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 29 19:22:15.105800 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.105743 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-h55mw\"" Jul 29 19:22:15.220665 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.220627 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d14301d0-e096-4f02-9556-fc2e15448f23-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8s7hd\" (UID: \"d14301d0-e096-4f02-9556-fc2e15448f23\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8s7hd" Jul 29 19:22:15.221082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.220690 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77bhx\" (UniqueName: \"kubernetes.io/projected/d14301d0-e096-4f02-9556-fc2e15448f23-kube-api-access-77bhx\") pod \"cert-manager-operator-controller-manager-55c444bf86-8s7hd\" (UID: \"d14301d0-e096-4f02-9556-fc2e15448f23\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8s7hd" Jul 29 19:22:15.321372 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.321285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d14301d0-e096-4f02-9556-fc2e15448f23-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8s7hd\" (UID: \"d14301d0-e096-4f02-9556-fc2e15448f23\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8s7hd" Jul 29 19:22:15.321372 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.321345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77bhx\" (UniqueName: \"kubernetes.io/projected/d14301d0-e096-4f02-9556-fc2e15448f23-kube-api-access-77bhx\") pod \"cert-manager-operator-controller-manager-55c444bf86-8s7hd\" (UID: \"d14301d0-e096-4f02-9556-fc2e15448f23\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8s7hd" Jul 29 19:22:15.321733 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.321712 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d14301d0-e096-4f02-9556-fc2e15448f23-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8s7hd\" (UID: \"d14301d0-e096-4f02-9556-fc2e15448f23\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8s7hd" Jul 29 19:22:15.330766 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.330739 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77bhx\" (UniqueName: \"kubernetes.io/projected/d14301d0-e096-4f02-9556-fc2e15448f23-kube-api-access-77bhx\") pod \"cert-manager-operator-controller-manager-55c444bf86-8s7hd\" (UID: \"d14301d0-e096-4f02-9556-fc2e15448f23\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8s7hd" Jul 29 19:22:15.412360 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.412322 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8s7hd" Jul 29 19:22:15.578143 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:22:15.578111 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd14301d0_e096_4f02_9556_fc2e15448f23.slice/crio-8e1c8b67bdcbc0c5b82202de76cab7f48a488f2725623834f6123867b7255ca3 WatchSource:0}: Error finding container 8e1c8b67bdcbc0c5b82202de76cab7f48a488f2725623834f6123867b7255ca3: Status 404 returned error can't find the container with id 8e1c8b67bdcbc0c5b82202de76cab7f48a488f2725623834f6123867b7255ca3 Jul 29 19:22:15.578807 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:15.578782 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8s7hd"] Jul 29 19:22:16.162976 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:16.162940 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8s7hd" event={"ID":"d14301d0-e096-4f02-9556-fc2e15448f23","Type":"ContainerStarted","Data":"8e1c8b67bdcbc0c5b82202de76cab7f48a488f2725623834f6123867b7255ca3"} Jul 29 19:22:16.958939 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:16.958901 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:17.073863 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:17.073814 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:18.176650 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:18.176556 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8s7hd" event={"ID":"d14301d0-e096-4f02-9556-fc2e15448f23","Type":"ContainerStarted","Data":"c827a07b185d50825130263cf6cf111ba7f63a3a33ea85b00e31680897eca470"} Jul 29 19:22:18.204160 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:18.204100 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8s7hd" podStartSLOduration=0.894125721 podStartE2EDuration="3.204083749s" totalImagesPullingTime="2.309958028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:22:18.203307797 +0000 UTC m=+328.091615040" watchObservedRunningTime="2026-07-29 19:22:18.204083749 +0000 UTC m=+328.092390976" Jul 29 19:22:18.698545 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:18.698490 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:18.820004 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:18.819967 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:19.147449 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.147415 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:19.305984 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.305951 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:19.393806 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.393777 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj"] Jul 29 19:22:19.414786 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.414719 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" Jul 29 19:22:19.419441 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.419413 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 19:22:19.419606 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.419443 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kgmlm\"" Jul 29 19:22:19.422027 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.421860 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj"] Jul 29 19:22:19.426899 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.426876 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 19:22:19.460641 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.460605 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3c4592f-c4a1-45ce-a831-e9f744f9b155-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj\" (UID: \"e3c4592f-c4a1-45ce-a831-e9f744f9b155\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" Jul 29 19:22:19.460802 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.460645 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h4ll\" (UniqueName: \"kubernetes.io/projected/e3c4592f-c4a1-45ce-a831-e9f744f9b155-kube-api-access-7h4ll\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj\" (UID: \"e3c4592f-c4a1-45ce-a831-e9f744f9b155\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" Jul 29 19:22:19.460802 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.460693 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3c4592f-c4a1-45ce-a831-e9f744f9b155-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj\" (UID: \"e3c4592f-c4a1-45ce-a831-e9f744f9b155\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" Jul 29 19:22:19.561742 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.561705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3c4592f-c4a1-45ce-a831-e9f744f9b155-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj\" (UID: \"e3c4592f-c4a1-45ce-a831-e9f744f9b155\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" Jul 29 19:22:19.561742 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.561742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h4ll\" (UniqueName: \"kubernetes.io/projected/e3c4592f-c4a1-45ce-a831-e9f744f9b155-kube-api-access-7h4ll\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj\" (UID: \"e3c4592f-c4a1-45ce-a831-e9f744f9b155\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" Jul 29 19:22:19.561934 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.561784 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3c4592f-c4a1-45ce-a831-e9f744f9b155-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj\" (UID: \"e3c4592f-c4a1-45ce-a831-e9f744f9b155\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" Jul 29 19:22:19.562098 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.562081 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3c4592f-c4a1-45ce-a831-e9f744f9b155-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj\" (UID: \"e3c4592f-c4a1-45ce-a831-e9f744f9b155\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" Jul 29 19:22:19.562144 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.562115 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3c4592f-c4a1-45ce-a831-e9f744f9b155-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj\" (UID: \"e3c4592f-c4a1-45ce-a831-e9f744f9b155\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" Jul 29 19:22:19.612039 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.612003 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h4ll\" (UniqueName: \"kubernetes.io/projected/e3c4592f-c4a1-45ce-a831-e9f744f9b155-kube-api-access-7h4ll\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj\" (UID: \"e3c4592f-c4a1-45ce-a831-e9f744f9b155\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" Jul 29 19:22:19.725120 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.725033 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" Jul 29 19:22:19.906295 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:19.906240 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj"] Jul 29 19:22:19.908995 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:22:19.908965 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c4592f_c4a1_45ce_a831_e9f744f9b155.slice/crio-bec081a9579d385d8624f880e7f7f0a3a8fa9f39f8e725ff9324e083fbce323f WatchSource:0}: Error finding container bec081a9579d385d8624f880e7f7f0a3a8fa9f39f8e725ff9324e083fbce323f: Status 404 returned error can't find the container with id bec081a9579d385d8624f880e7f7f0a3a8fa9f39f8e725ff9324e083fbce323f Jul 29 19:22:20.186418 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:20.186382 2574 generic.go:356] "Generic (PLEG): container finished" podID="e3c4592f-c4a1-45ce-a831-e9f744f9b155" containerID="591dec135df693e114ed2e97a3d76fa4f3b4e64829c8dc225b902409c568a5f9" exitCode=0 Jul 29 19:22:20.186636 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:20.186475 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" event={"ID":"e3c4592f-c4a1-45ce-a831-e9f744f9b155","Type":"ContainerDied","Data":"591dec135df693e114ed2e97a3d76fa4f3b4e64829c8dc225b902409c568a5f9"} Jul 29 19:22:20.186636 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:20.186558 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" event={"ID":"e3c4592f-c4a1-45ce-a831-e9f744f9b155","Type":"ContainerStarted","Data":"bec081a9579d385d8624f880e7f7f0a3a8fa9f39f8e725ff9324e083fbce323f"} Jul 29 19:22:21.148025 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:21.147987 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:21.548784 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:21.548698 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:22.032846 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:22.032813 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zb68d"] Jul 29 19:22:22.034956 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:22.034923 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zb68d" Jul 29 19:22:22.037001 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:22.036974 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-kw8n2\"" Jul 29 19:22:22.037001 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:22.036990 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 29 19:22:22.037259 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:22.037240 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 29 19:22:22.044739 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:22.044718 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zb68d"] Jul 29 19:22:22.184582 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:22.184543 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwkdd\" (UniqueName: \"kubernetes.io/projected/52203939-39b1-49f9-a8fa-2b411bd27b6a-kube-api-access-zwkdd\") pod \"cert-manager-cainjector-559cdd8c87-zb68d\" (UID: \"52203939-39b1-49f9-a8fa-2b411bd27b6a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zb68d" Jul 29 19:22:22.185034 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:22.184627 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52203939-39b1-49f9-a8fa-2b411bd27b6a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zb68d\" (UID: \"52203939-39b1-49f9-a8fa-2b411bd27b6a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zb68d" Jul 29 19:22:22.285658 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:22.285578 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52203939-39b1-49f9-a8fa-2b411bd27b6a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zb68d\" (UID: \"52203939-39b1-49f9-a8fa-2b411bd27b6a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zb68d" Jul 29 19:22:22.285816 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:22.285677 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwkdd\" (UniqueName: \"kubernetes.io/projected/52203939-39b1-49f9-a8fa-2b411bd27b6a-kube-api-access-zwkdd\") pod \"cert-manager-cainjector-559cdd8c87-zb68d\" (UID: \"52203939-39b1-49f9-a8fa-2b411bd27b6a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zb68d" Jul 29 19:22:22.295148 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:22.295122 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52203939-39b1-49f9-a8fa-2b411bd27b6a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zb68d\" (UID: \"52203939-39b1-49f9-a8fa-2b411bd27b6a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zb68d" Jul 29 19:22:22.295408 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:22.295377 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwkdd\" (UniqueName: \"kubernetes.io/projected/52203939-39b1-49f9-a8fa-2b411bd27b6a-kube-api-access-zwkdd\") pod \"cert-manager-cainjector-559cdd8c87-zb68d\" (UID: \"52203939-39b1-49f9-a8fa-2b411bd27b6a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zb68d" Jul 29 19:22:22.352719 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:22.352685 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zb68d" Jul 29 19:22:22.859753 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:22.859719 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zb68d"] Jul 29 19:22:22.863148 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:22:22.863118 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52203939_39b1_49f9_a8fa_2b411bd27b6a.slice/crio-0060ce9d4f739dc6d989e542a92d39d9c1b64d6a8dd8b36514b5d8df591cab65 WatchSource:0}: Error finding container 0060ce9d4f739dc6d989e542a92d39d9c1b64d6a8dd8b36514b5d8df591cab65: Status 404 returned error can't find the container with id 0060ce9d4f739dc6d989e542a92d39d9c1b64d6a8dd8b36514b5d8df591cab65 Jul 29 19:22:23.202668 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:23.202625 2574 generic.go:356] "Generic (PLEG): container finished" podID="e3c4592f-c4a1-45ce-a831-e9f744f9b155" containerID="7db03887190f0e05dd14e6129054f84514e54f7112c2deb88cb7f2d2a7cbb09f" exitCode=0 Jul 29 19:22:23.203180 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:23.202718 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" event={"ID":"e3c4592f-c4a1-45ce-a831-e9f744f9b155","Type":"ContainerDied","Data":"7db03887190f0e05dd14e6129054f84514e54f7112c2deb88cb7f2d2a7cbb09f"} Jul 29 19:22:23.203966 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:23.203945 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zb68d" event={"ID":"52203939-39b1-49f9-a8fa-2b411bd27b6a","Type":"ContainerStarted","Data":"0060ce9d4f739dc6d989e542a92d39d9c1b64d6a8dd8b36514b5d8df591cab65"} Jul 29 19:22:23.749240 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:23.749198 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:23.825136 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:23.825091 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:24.209828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:24.209791 2574 generic.go:356] "Generic (PLEG): container finished" podID="e3c4592f-c4a1-45ce-a831-e9f744f9b155" containerID="650d51dc3d40878cb987851619265f4c3853f2bf1ab5446e24385b92521a2cdf" exitCode=0 Jul 29 19:22:24.210235 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:24.209871 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" event={"ID":"e3c4592f-c4a1-45ce-a831-e9f744f9b155","Type":"ContainerDied","Data":"650d51dc3d40878cb987851619265f4c3853f2bf1ab5446e24385b92521a2cdf"} Jul 29 19:22:25.356845 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:25.356818 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" Jul 29 19:22:25.514224 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:25.514137 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h4ll\" (UniqueName: \"kubernetes.io/projected/e3c4592f-c4a1-45ce-a831-e9f744f9b155-kube-api-access-7h4ll\") pod \"e3c4592f-c4a1-45ce-a831-e9f744f9b155\" (UID: \"e3c4592f-c4a1-45ce-a831-e9f744f9b155\") " Jul 29 19:22:25.514224 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:25.514204 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3c4592f-c4a1-45ce-a831-e9f744f9b155-util\") pod \"e3c4592f-c4a1-45ce-a831-e9f744f9b155\" (UID: \"e3c4592f-c4a1-45ce-a831-e9f744f9b155\") " Jul 29 19:22:25.514443 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:25.514308 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3c4592f-c4a1-45ce-a831-e9f744f9b155-bundle\") pod \"e3c4592f-c4a1-45ce-a831-e9f744f9b155\" (UID: \"e3c4592f-c4a1-45ce-a831-e9f744f9b155\") " Jul 29 19:22:25.514846 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:25.514813 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3c4592f-c4a1-45ce-a831-e9f744f9b155-bundle" (OuterVolumeSpecName: "bundle") pod "e3c4592f-c4a1-45ce-a831-e9f744f9b155" (UID: "e3c4592f-c4a1-45ce-a831-e9f744f9b155"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:22:25.516895 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:25.516862 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3c4592f-c4a1-45ce-a831-e9f744f9b155-kube-api-access-7h4ll" (OuterVolumeSpecName: "kube-api-access-7h4ll") pod "e3c4592f-c4a1-45ce-a831-e9f744f9b155" (UID: "e3c4592f-c4a1-45ce-a831-e9f744f9b155"). InnerVolumeSpecName "kube-api-access-7h4ll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:22:25.520586 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:25.520554 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3c4592f-c4a1-45ce-a831-e9f744f9b155-util" (OuterVolumeSpecName: "util") pod "e3c4592f-c4a1-45ce-a831-e9f744f9b155" (UID: "e3c4592f-c4a1-45ce-a831-e9f744f9b155"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:22:25.615793 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:25.615756 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3c4592f-c4a1-45ce-a831-e9f744f9b155-util\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:22:25.615793 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:25.615790 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3c4592f-c4a1-45ce-a831-e9f744f9b155-bundle\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:22:25.615793 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:25.615800 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7h4ll\" (UniqueName: \"kubernetes.io/projected/e3c4592f-c4a1-45ce-a831-e9f744f9b155-kube-api-access-7h4ll\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:22:26.220936 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:26.220906 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" Jul 29 19:22:26.220936 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:26.220924 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tbzj" event={"ID":"e3c4592f-c4a1-45ce-a831-e9f744f9b155","Type":"ContainerDied","Data":"bec081a9579d385d8624f880e7f7f0a3a8fa9f39f8e725ff9324e083fbce323f"} Jul 29 19:22:26.221176 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:26.220977 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bec081a9579d385d8624f880e7f7f0a3a8fa9f39f8e725ff9324e083fbce323f" Jul 29 19:22:27.228026 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:27.227980 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zb68d" event={"ID":"52203939-39b1-49f9-a8fa-2b411bd27b6a","Type":"ContainerStarted","Data":"481714f92ea46464da579fb22228a78058ccb09d0bf9518ff5069e260c542094"} Jul 29 19:22:27.246488 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:27.246425 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zb68d" podStartSLOduration=0.956661107 podStartE2EDuration="5.246404888s" totalImagesPullingTime="4.289743781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:22:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:22:27.245636089 +0000 UTC m=+337.133943318" watchObservedRunningTime="2026-07-29 19:22:27.246404888 +0000 UTC m=+337.134712117" Jul 29 19:22:29.151779 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.151742 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:29.585287 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.585203 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hhdp2"] Jul 29 19:22:29.585524 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.585497 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3c4592f-c4a1-45ce-a831-e9f744f9b155" containerName="util" Jul 29 19:22:29.585524 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.585523 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3c4592f-c4a1-45ce-a831-e9f744f9b155" containerName="util" Jul 29 19:22:29.585615 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.585533 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3c4592f-c4a1-45ce-a831-e9f744f9b155" containerName="pull" Jul 29 19:22:29.585615 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.585539 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3c4592f-c4a1-45ce-a831-e9f744f9b155" containerName="pull" Jul 29 19:22:29.585615 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.585554 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3c4592f-c4a1-45ce-a831-e9f744f9b155" containerName="extract" Jul 29 19:22:29.585615 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.585560 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3c4592f-c4a1-45ce-a831-e9f744f9b155" containerName="extract" Jul 29 19:22:29.585615 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.585611 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3c4592f-c4a1-45ce-a831-e9f744f9b155" containerName="extract" Jul 29 19:22:29.587568 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.587552 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hhdp2" Jul 29 19:22:29.589536 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.589493 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6h7wf\"" Jul 29 19:22:29.595954 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.595926 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hhdp2"] Jul 29 19:22:29.753636 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.753600 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7bf357f5-07a6-42d1-9672-9979d56b99b2-bound-sa-token\") pod \"cert-manager-55b4d954d5-hhdp2\" (UID: \"7bf357f5-07a6-42d1-9672-9979d56b99b2\") " pod="cert-manager/cert-manager-55b4d954d5-hhdp2" Jul 29 19:22:29.753811 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.753648 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-229rp\" (UniqueName: \"kubernetes.io/projected/7bf357f5-07a6-42d1-9672-9979d56b99b2-kube-api-access-229rp\") pod \"cert-manager-55b4d954d5-hhdp2\" (UID: \"7bf357f5-07a6-42d1-9672-9979d56b99b2\") " pod="cert-manager/cert-manager-55b4d954d5-hhdp2" Jul 29 19:22:29.854619 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.854533 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7bf357f5-07a6-42d1-9672-9979d56b99b2-bound-sa-token\") pod \"cert-manager-55b4d954d5-hhdp2\" (UID: \"7bf357f5-07a6-42d1-9672-9979d56b99b2\") " pod="cert-manager/cert-manager-55b4d954d5-hhdp2" Jul 29 19:22:29.854619 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.854578 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-229rp\" (UniqueName: \"kubernetes.io/projected/7bf357f5-07a6-42d1-9672-9979d56b99b2-kube-api-access-229rp\") pod \"cert-manager-55b4d954d5-hhdp2\" (UID: \"7bf357f5-07a6-42d1-9672-9979d56b99b2\") " pod="cert-manager/cert-manager-55b4d954d5-hhdp2" Jul 29 19:22:29.862431 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.862401 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-229rp\" (UniqueName: \"kubernetes.io/projected/7bf357f5-07a6-42d1-9672-9979d56b99b2-kube-api-access-229rp\") pod \"cert-manager-55b4d954d5-hhdp2\" (UID: \"7bf357f5-07a6-42d1-9672-9979d56b99b2\") " pod="cert-manager/cert-manager-55b4d954d5-hhdp2" Jul 29 19:22:29.862620 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.862598 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7bf357f5-07a6-42d1-9672-9979d56b99b2-bound-sa-token\") pod \"cert-manager-55b4d954d5-hhdp2\" (UID: \"7bf357f5-07a6-42d1-9672-9979d56b99b2\") " pod="cert-manager/cert-manager-55b4d954d5-hhdp2" Jul 29 19:22:29.896604 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:29.896572 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hhdp2" Jul 29 19:22:30.012463 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:30.009059 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:30.042427 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:30.042392 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hhdp2"] Jul 29 19:22:30.046066 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:22:30.046035 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7bf357f5_07a6_42d1_9672_9979d56b99b2.slice/crio-317651c2c062ecb5dc767642eb4ba5bff5cf024a423523dd5f0391300701fe6b WatchSource:0}: Error finding container 317651c2c062ecb5dc767642eb4ba5bff5cf024a423523dd5f0391300701fe6b: Status 404 returned error can't find the container with id 317651c2c062ecb5dc767642eb4ba5bff5cf024a423523dd5f0391300701fe6b Jul 29 19:22:30.124632 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:30.124539 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:30.224037 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:30.224003 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:30.242085 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:30.242052 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hhdp2" event={"ID":"7bf357f5-07a6-42d1-9672-9979d56b99b2","Type":"ContainerStarted","Data":"1268900e497430b49263e93a40773a101b1868ecb6f416bf8b139e1edcec2519"} Jul 29 19:22:30.242239 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:30.242091 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hhdp2" event={"ID":"7bf357f5-07a6-42d1-9672-9979d56b99b2","Type":"ContainerStarted","Data":"317651c2c062ecb5dc767642eb4ba5bff5cf024a423523dd5f0391300701fe6b"} Jul 29 19:22:30.263034 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:30.262984 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-hhdp2" podStartSLOduration=1.262969205 podStartE2EDuration="1.262969205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:22:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:22:30.262011159 +0000 UTC m=+340.150318386" watchObservedRunningTime="2026-07-29 19:22:30.262969205 +0000 UTC m=+340.151276433" Jul 29 19:22:36.417086 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:36.417039 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:36.515444 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:36.515401 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:38.398094 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:38.398062 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:39.979929 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:39.979896 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb"] Jul 29 19:22:39.982323 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:39.982306 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" Jul 29 19:22:39.984619 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:39.984594 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 19:22:39.984743 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:39.984594 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 19:22:39.984935 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:39.984914 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kgmlm\"" Jul 29 19:22:39.992417 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:39.992395 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb"] Jul 29 19:22:40.141825 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:40.141794 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc8nc\" (UniqueName: \"kubernetes.io/projected/b4ee5c02-d653-426f-8a43-ee0317b77dae-kube-api-access-dc8nc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb\" (UID: \"b4ee5c02-d653-426f-8a43-ee0317b77dae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" Jul 29 19:22:40.141996 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:40.141838 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4ee5c02-d653-426f-8a43-ee0317b77dae-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb\" (UID: \"b4ee5c02-d653-426f-8a43-ee0317b77dae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" Jul 29 19:22:40.141996 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:40.141919 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4ee5c02-d653-426f-8a43-ee0317b77dae-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb\" (UID: \"b4ee5c02-d653-426f-8a43-ee0317b77dae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" Jul 29 19:22:40.242978 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:40.242887 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc8nc\" (UniqueName: \"kubernetes.io/projected/b4ee5c02-d653-426f-8a43-ee0317b77dae-kube-api-access-dc8nc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb\" (UID: \"b4ee5c02-d653-426f-8a43-ee0317b77dae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" Jul 29 19:22:40.242978 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:40.242938 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4ee5c02-d653-426f-8a43-ee0317b77dae-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb\" (UID: \"b4ee5c02-d653-426f-8a43-ee0317b77dae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" Jul 29 19:22:40.242978 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:40.242972 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4ee5c02-d653-426f-8a43-ee0317b77dae-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb\" (UID: \"b4ee5c02-d653-426f-8a43-ee0317b77dae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" Jul 29 19:22:40.243360 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:40.243345 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4ee5c02-d653-426f-8a43-ee0317b77dae-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb\" (UID: \"b4ee5c02-d653-426f-8a43-ee0317b77dae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" Jul 29 19:22:40.243406 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:40.243387 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4ee5c02-d653-426f-8a43-ee0317b77dae-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb\" (UID: \"b4ee5c02-d653-426f-8a43-ee0317b77dae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" Jul 29 19:22:40.251424 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:40.251398 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc8nc\" (UniqueName: \"kubernetes.io/projected/b4ee5c02-d653-426f-8a43-ee0317b77dae-kube-api-access-dc8nc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb\" (UID: \"b4ee5c02-d653-426f-8a43-ee0317b77dae\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" Jul 29 19:22:40.292170 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:40.292147 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" Jul 29 19:22:40.414306 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:40.414255 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb"] Jul 29 19:22:40.419246 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:22:40.419185 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4ee5c02_d653_426f_8a43_ee0317b77dae.slice/crio-400c4e78e73c33bcd365b2c1a1be2bc475150e9a77dcdd993befc62a6f44b0d5 WatchSource:0}: Error finding container 400c4e78e73c33bcd365b2c1a1be2bc475150e9a77dcdd993befc62a6f44b0d5: Status 404 returned error can't find the container with id 400c4e78e73c33bcd365b2c1a1be2bc475150e9a77dcdd993befc62a6f44b0d5 Jul 29 19:22:41.291450 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:41.291420 2574 generic.go:356] "Generic (PLEG): container finished" podID="b4ee5c02-d653-426f-8a43-ee0317b77dae" containerID="582a430377f4065725fc451105ce7b88c8f99ab17e4f1ecc7608a68b6e4e7b8e" exitCode=0 Jul 29 19:22:41.291822 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:41.291524 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" event={"ID":"b4ee5c02-d653-426f-8a43-ee0317b77dae","Type":"ContainerDied","Data":"582a430377f4065725fc451105ce7b88c8f99ab17e4f1ecc7608a68b6e4e7b8e"} Jul 29 19:22:41.291822 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:41.291579 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" event={"ID":"b4ee5c02-d653-426f-8a43-ee0317b77dae","Type":"ContainerStarted","Data":"400c4e78e73c33bcd365b2c1a1be2bc475150e9a77dcdd993befc62a6f44b0d5"} Jul 29 19:22:42.297831 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:42.297795 2574 generic.go:356] "Generic (PLEG): container finished" podID="b4ee5c02-d653-426f-8a43-ee0317b77dae" containerID="4d6ced80dd48dfa067addcb970ce8e642ec60dd3081d5868e0ffa5685fb9c3e8" exitCode=0 Jul 29 19:22:42.298300 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:42.297865 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" event={"ID":"b4ee5c02-d653-426f-8a43-ee0317b77dae","Type":"ContainerDied","Data":"4d6ced80dd48dfa067addcb970ce8e642ec60dd3081d5868e0ffa5685fb9c3e8"} Jul 29 19:22:43.308958 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:43.308858 2574 generic.go:356] "Generic (PLEG): container finished" podID="b4ee5c02-d653-426f-8a43-ee0317b77dae" containerID="fc84c93501164380284962cbcc1d2dfcf5219f08107fccb3ae61084109c20bdc" exitCode=0 Jul 29 19:22:43.308958 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:43.308913 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" event={"ID":"b4ee5c02-d653-426f-8a43-ee0317b77dae","Type":"ContainerDied","Data":"fc84c93501164380284962cbcc1d2dfcf5219f08107fccb3ae61084109c20bdc"} Jul 29 19:22:44.437071 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:44.437048 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" Jul 29 19:22:44.577325 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:44.577239 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc8nc\" (UniqueName: \"kubernetes.io/projected/b4ee5c02-d653-426f-8a43-ee0317b77dae-kube-api-access-dc8nc\") pod \"b4ee5c02-d653-426f-8a43-ee0317b77dae\" (UID: \"b4ee5c02-d653-426f-8a43-ee0317b77dae\") " Jul 29 19:22:44.577325 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:44.577306 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4ee5c02-d653-426f-8a43-ee0317b77dae-bundle\") pod \"b4ee5c02-d653-426f-8a43-ee0317b77dae\" (UID: \"b4ee5c02-d653-426f-8a43-ee0317b77dae\") " Jul 29 19:22:44.577580 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:44.577329 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4ee5c02-d653-426f-8a43-ee0317b77dae-util\") pod \"b4ee5c02-d653-426f-8a43-ee0317b77dae\" (UID: \"b4ee5c02-d653-426f-8a43-ee0317b77dae\") " Jul 29 19:22:44.578095 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:44.578070 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ee5c02-d653-426f-8a43-ee0317b77dae-bundle" (OuterVolumeSpecName: "bundle") pod "b4ee5c02-d653-426f-8a43-ee0317b77dae" (UID: "b4ee5c02-d653-426f-8a43-ee0317b77dae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:22:44.579349 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:44.579323 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ee5c02-d653-426f-8a43-ee0317b77dae-kube-api-access-dc8nc" (OuterVolumeSpecName: "kube-api-access-dc8nc") pod "b4ee5c02-d653-426f-8a43-ee0317b77dae" (UID: "b4ee5c02-d653-426f-8a43-ee0317b77dae"). InnerVolumeSpecName "kube-api-access-dc8nc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:22:44.582812 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:44.582781 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ee5c02-d653-426f-8a43-ee0317b77dae-util" (OuterVolumeSpecName: "util") pod "b4ee5c02-d653-426f-8a43-ee0317b77dae" (UID: "b4ee5c02-d653-426f-8a43-ee0317b77dae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:22:44.678587 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:44.678559 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4ee5c02-d653-426f-8a43-ee0317b77dae-bundle\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:22:44.678587 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:44.678579 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4ee5c02-d653-426f-8a43-ee0317b77dae-util\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:22:44.678587 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:44.678588 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc8nc\" (UniqueName: \"kubernetes.io/projected/b4ee5c02-d653-426f-8a43-ee0317b77dae-kube-api-access-dc8nc\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:22:45.318788 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:45.318759 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" Jul 29 19:22:45.318788 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:45.318777 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9svcb" event={"ID":"b4ee5c02-d653-426f-8a43-ee0317b77dae","Type":"ContainerDied","Data":"400c4e78e73c33bcd365b2c1a1be2bc475150e9a77dcdd993befc62a6f44b0d5"} Jul 29 19:22:45.318996 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:45.318815 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="400c4e78e73c33bcd365b2c1a1be2bc475150e9a77dcdd993befc62a6f44b0d5" Jul 29 19:22:50.946165 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:50.946125 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:51.043192 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:51.043156 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:51.611660 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:51.611630 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:51.824919 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:51.824887 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:51.958069 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:51.958036 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:52.043378 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.043345 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2"] Jul 29 19:22:52.043662 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.043650 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ee5c02-d653-426f-8a43-ee0317b77dae" containerName="util" Jul 29 19:22:52.043712 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.043664 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ee5c02-d653-426f-8a43-ee0317b77dae" containerName="util" Jul 29 19:22:52.043712 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.043675 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ee5c02-d653-426f-8a43-ee0317b77dae" containerName="extract" Jul 29 19:22:52.043712 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.043681 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ee5c02-d653-426f-8a43-ee0317b77dae" containerName="extract" Jul 29 19:22:52.043712 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.043696 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ee5c02-d653-426f-8a43-ee0317b77dae" containerName="pull" Jul 29 19:22:52.043712 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.043702 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ee5c02-d653-426f-8a43-ee0317b77dae" containerName="pull" Jul 29 19:22:52.043872 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.043753 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ee5c02-d653-426f-8a43-ee0317b77dae" containerName="extract" Jul 29 19:22:52.049398 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.049380 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.061772 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.061749 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 29 19:22:52.061869 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.061841 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 29 19:22:52.062311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.062297 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mq2dv\"" Jul 29 19:22:52.062457 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.062441 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 29 19:22:52.062718 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.062698 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 29 19:22:52.140579 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.140548 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c930d9a3-9358-431a-a32a-792d58dfd8bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-667b7bc75f-cqqx2\" (UID: \"c930d9a3-9358-431a-a32a-792d58dfd8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.140723 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.140621 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c930d9a3-9358-431a-a32a-792d58dfd8bb-tmp\") pod \"opendatahub-operator-controller-manager-667b7bc75f-cqqx2\" (UID: \"c930d9a3-9358-431a-a32a-792d58dfd8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.140723 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.140672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxjx5\" (UniqueName: \"kubernetes.io/projected/c930d9a3-9358-431a-a32a-792d58dfd8bb-kube-api-access-jxjx5\") pod \"opendatahub-operator-controller-manager-667b7bc75f-cqqx2\" (UID: \"c930d9a3-9358-431a-a32a-792d58dfd8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.140723 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.140707 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c930d9a3-9358-431a-a32a-792d58dfd8bb-manifests\") pod \"opendatahub-operator-controller-manager-667b7bc75f-cqqx2\" (UID: \"c930d9a3-9358-431a-a32a-792d58dfd8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.140856 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.140725 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c930d9a3-9358-431a-a32a-792d58dfd8bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-667b7bc75f-cqqx2\" (UID: \"c930d9a3-9358-431a-a32a-792d58dfd8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.241973 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.241893 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c930d9a3-9358-431a-a32a-792d58dfd8bb-tmp\") pod \"opendatahub-operator-controller-manager-667b7bc75f-cqqx2\" (UID: \"c930d9a3-9358-431a-a32a-792d58dfd8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.241973 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.241927 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxjx5\" (UniqueName: \"kubernetes.io/projected/c930d9a3-9358-431a-a32a-792d58dfd8bb-kube-api-access-jxjx5\") pod \"opendatahub-operator-controller-manager-667b7bc75f-cqqx2\" (UID: \"c930d9a3-9358-431a-a32a-792d58dfd8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.241973 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.241946 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c930d9a3-9358-431a-a32a-792d58dfd8bb-manifests\") pod \"opendatahub-operator-controller-manager-667b7bc75f-cqqx2\" (UID: \"c930d9a3-9358-431a-a32a-792d58dfd8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.241973 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.241961 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c930d9a3-9358-431a-a32a-792d58dfd8bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-667b7bc75f-cqqx2\" (UID: \"c930d9a3-9358-431a-a32a-792d58dfd8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.242267 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.242006 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c930d9a3-9358-431a-a32a-792d58dfd8bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-667b7bc75f-cqqx2\" (UID: \"c930d9a3-9358-431a-a32a-792d58dfd8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.242325 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.242290 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c930d9a3-9358-431a-a32a-792d58dfd8bb-manifests\") pod \"opendatahub-operator-controller-manager-667b7bc75f-cqqx2\" (UID: \"c930d9a3-9358-431a-a32a-792d58dfd8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.244300 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.244281 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c930d9a3-9358-431a-a32a-792d58dfd8bb-tmp\") pod \"opendatahub-operator-controller-manager-667b7bc75f-cqqx2\" (UID: \"c930d9a3-9358-431a-a32a-792d58dfd8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.244452 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.244434 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c930d9a3-9358-431a-a32a-792d58dfd8bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-667b7bc75f-cqqx2\" (UID: \"c930d9a3-9358-431a-a32a-792d58dfd8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.244552 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.244536 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c930d9a3-9358-431a-a32a-792d58dfd8bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-667b7bc75f-cqqx2\" (UID: \"c930d9a3-9358-431a-a32a-792d58dfd8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.268930 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.268905 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxjx5\" (UniqueName: \"kubernetes.io/projected/c930d9a3-9358-431a-a32a-792d58dfd8bb-kube-api-access-jxjx5\") pod \"opendatahub-operator-controller-manager-667b7bc75f-cqqx2\" (UID: \"c930d9a3-9358-431a-a32a-792d58dfd8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.281150 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.281128 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2"] Jul 29 19:22:52.359171 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.359141 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:52.410557 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.410440 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:52.497542 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.497421 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:52.503375 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.503320 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2"] Jul 29 19:22:52.505623 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:22:52.505599 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc930d9a3_9358_431a_a32a_792d58dfd8bb.slice/crio-ebc9edf56852474aea17301f8518a1937e34f281b32106a238d0e919d74772b1 WatchSource:0}: Error finding container ebc9edf56852474aea17301f8518a1937e34f281b32106a238d0e919d74772b1: Status 404 returned error can't find the container with id ebc9edf56852474aea17301f8518a1937e34f281b32106a238d0e919d74772b1 Jul 29 19:22:52.569468 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.569437 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:52.669955 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.669920 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:52.781883 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.781807 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:52.884603 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:52.884570 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:22:53.355601 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:53.355563 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" event={"ID":"c930d9a3-9358-431a-a32a-792d58dfd8bb","Type":"ContainerStarted","Data":"ebc9edf56852474aea17301f8518a1937e34f281b32106a238d0e919d74772b1"} Jul 29 19:22:56.373138 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:56.373091 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" event={"ID":"c930d9a3-9358-431a-a32a-792d58dfd8bb","Type":"ContainerStarted","Data":"4c27bce32f8bd888c51adcac2beb993e2d9e4d74453a4137954e4ca05792c8ed"} Jul 29 19:22:57.381775 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:57.381732 2574 generic.go:356] "Generic (PLEG): container finished" podID="c930d9a3-9358-431a-a32a-792d58dfd8bb" containerID="4c27bce32f8bd888c51adcac2beb993e2d9e4d74453a4137954e4ca05792c8ed" exitCode=0 Jul 29 19:22:57.382229 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:57.381814 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" event={"ID":"c930d9a3-9358-431a-a32a-792d58dfd8bb","Type":"ContainerDied","Data":"4c27bce32f8bd888c51adcac2beb993e2d9e4d74453a4137954e4ca05792c8ed"} Jul 29 19:22:58.388522 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:58.388486 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" event={"ID":"c930d9a3-9358-431a-a32a-792d58dfd8bb","Type":"ContainerStarted","Data":"6255b225fdf58ea0eba8c9ffbbf3ccd529e487493efedcdd81a3c70c85327479"} Jul 29 19:22:58.388926 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:58.388669 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:22:58.411890 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:22:58.411834 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" podStartSLOduration=1.936651396 podStartE2EDuration="6.411818727s" totalImagesPullingTime="3.429556056s" totalInitContainerRuntime="1.045611275s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:22:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:22:58.410565123 +0000 UTC m=+368.298872349" watchObservedRunningTime="2026-07-29 19:22:58.411818727 +0000 UTC m=+368.300125953" Jul 29 19:23:03.114065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:03.114025 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:03.210173 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:03.210137 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:04.765965 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:04.765935 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:04.870749 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:04.870717 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:09.394329 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:09.394297 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-667b7bc75f-cqqx2" Jul 29 19:23:11.152191 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.152157 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn"] Jul 29 19:23:11.160152 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.160131 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" Jul 29 19:23:11.168282 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.168259 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 29 19:23:11.168521 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.168485 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 29 19:23:11.168607 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.168580 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 29 19:23:11.168672 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.168580 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 29 19:23:11.168728 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.168688 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 29 19:23:11.168809 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.168795 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-k9gxk\"" Jul 29 19:23:11.173330 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.173307 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn"] Jul 29 19:23:11.187145 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.187111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2d80e96-d941-471a-a082-1de851811f0f-cert\") pod \"lws-controller-manager-848988bfdc-7pwqn\" (UID: \"d2d80e96-d941-471a-a082-1de851811f0f\") " pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" Jul 29 19:23:11.187252 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.187155 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p55ww\" (UniqueName: \"kubernetes.io/projected/d2d80e96-d941-471a-a082-1de851811f0f-kube-api-access-p55ww\") pod \"lws-controller-manager-848988bfdc-7pwqn\" (UID: \"d2d80e96-d941-471a-a082-1de851811f0f\") " pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" Jul 29 19:23:11.187315 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.187248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d2d80e96-d941-471a-a082-1de851811f0f-manager-config\") pod \"lws-controller-manager-848988bfdc-7pwqn\" (UID: \"d2d80e96-d941-471a-a082-1de851811f0f\") " pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" Jul 29 19:23:11.187315 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.187280 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2d80e96-d941-471a-a082-1de851811f0f-metrics-cert\") pod \"lws-controller-manager-848988bfdc-7pwqn\" (UID: \"d2d80e96-d941-471a-a082-1de851811f0f\") " pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" Jul 29 19:23:11.288076 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.288038 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2d80e96-d941-471a-a082-1de851811f0f-cert\") pod \"lws-controller-manager-848988bfdc-7pwqn\" (UID: \"d2d80e96-d941-471a-a082-1de851811f0f\") " pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" Jul 29 19:23:11.288076 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.288080 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p55ww\" (UniqueName: \"kubernetes.io/projected/d2d80e96-d941-471a-a082-1de851811f0f-kube-api-access-p55ww\") pod \"lws-controller-manager-848988bfdc-7pwqn\" (UID: \"d2d80e96-d941-471a-a082-1de851811f0f\") " pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" Jul 29 19:23:11.288329 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.288122 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d2d80e96-d941-471a-a082-1de851811f0f-manager-config\") pod \"lws-controller-manager-848988bfdc-7pwqn\" (UID: \"d2d80e96-d941-471a-a082-1de851811f0f\") " pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" Jul 29 19:23:11.288329 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.288141 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2d80e96-d941-471a-a082-1de851811f0f-metrics-cert\") pod \"lws-controller-manager-848988bfdc-7pwqn\" (UID: \"d2d80e96-d941-471a-a082-1de851811f0f\") " pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" Jul 29 19:23:11.288870 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.288847 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d2d80e96-d941-471a-a082-1de851811f0f-manager-config\") pod \"lws-controller-manager-848988bfdc-7pwqn\" (UID: \"d2d80e96-d941-471a-a082-1de851811f0f\") " pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" Jul 29 19:23:11.290475 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.290453 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2d80e96-d941-471a-a082-1de851811f0f-cert\") pod \"lws-controller-manager-848988bfdc-7pwqn\" (UID: \"d2d80e96-d941-471a-a082-1de851811f0f\") " pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" Jul 29 19:23:11.290663 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.290642 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2d80e96-d941-471a-a082-1de851811f0f-metrics-cert\") pod \"lws-controller-manager-848988bfdc-7pwqn\" (UID: \"d2d80e96-d941-471a-a082-1de851811f0f\") " pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" Jul 29 19:23:11.341407 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.341381 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p55ww\" (UniqueName: \"kubernetes.io/projected/d2d80e96-d941-471a-a082-1de851811f0f-kube-api-access-p55ww\") pod \"lws-controller-manager-848988bfdc-7pwqn\" (UID: \"d2d80e96-d941-471a-a082-1de851811f0f\") " pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" Jul 29 19:23:11.444227 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.444140 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:11.469490 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.469461 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" Jul 29 19:23:11.551169 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.551132 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:11.613257 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:11.613229 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn"] Jul 29 19:23:11.615376 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:23:11.615347 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d80e96_d941_471a_a082_1de851811f0f.slice/crio-c5f90ae927d4faffbf8813b48403d345a771396d03f4338ac87d4ab0383c47a4 WatchSource:0}: Error finding container c5f90ae927d4faffbf8813b48403d345a771396d03f4338ac87d4ab0383c47a4: Status 404 returned error can't find the container with id c5f90ae927d4faffbf8813b48403d345a771396d03f4338ac87d4ab0383c47a4 Jul 29 19:23:12.342550 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:12.342495 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:12.406483 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:12.406444 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:12.458420 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:12.458378 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" event={"ID":"d2d80e96-d941-471a-a082-1de851811f0f","Type":"ContainerStarted","Data":"c5f90ae927d4faffbf8813b48403d345a771396d03f4338ac87d4ab0383c47a4"} Jul 29 19:23:12.504619 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:12.504580 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:13.464421 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:13.464381 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" event={"ID":"d2d80e96-d941-471a-a082-1de851811f0f","Type":"ContainerStarted","Data":"acc1c3412ab166a67514f236327af62e675a57ab6ccc91e504f1dd6dd7116215"} Jul 29 19:23:13.464945 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:13.464532 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" Jul 29 19:23:13.498316 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:13.498270 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" podStartSLOduration=1.143218033 podStartE2EDuration="2.498256253s" totalImagesPullingTime="1.35503822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:23:13.495803037 +0000 UTC m=+383.384110264" watchObservedRunningTime="2026-07-29 19:23:13.498256253 +0000 UTC m=+383.386563480" Jul 29 19:23:14.575936 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:14.575900 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:14.645396 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:14.645367 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:22.936959 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:22.936920 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:23.136315 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:23.136276 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:23.536847 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:23.536808 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:23.646722 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:23.646688 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:23.802937 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:23.802852 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:23.894858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:23.894826 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:23.994453 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:23.994427 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:24.471012 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:24.470980 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-848988bfdc-7pwqn" Jul 29 19:23:25.012134 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:25.012098 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:25.119768 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:25.119735 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:25.272636 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:25.272554 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:25.650761 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:25.650730 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:25.772301 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:25.772268 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:27.224617 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:27.224573 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:31.916847 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:31.916812 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:32.031361 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.031333 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:32.332788 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.332710 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp"] Jul 29 19:23:32.339773 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.339752 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.344911 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.344890 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 29 19:23:32.345077 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.345056 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-nqgdj\"" Jul 29 19:23:32.365879 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.365857 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp"] Jul 29 19:23:32.385938 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.385903 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:32.462373 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.462337 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d403865e-797b-49a6-b37c-1697c377ed77-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.462556 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.462382 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d403865e-797b-49a6-b37c-1697c377ed77-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.462556 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.462413 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d403865e-797b-49a6-b37c-1697c377ed77-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.462556 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.462474 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-965f4\" (UniqueName: \"kubernetes.io/projected/d403865e-797b-49a6-b37c-1697c377ed77-kube-api-access-965f4\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.462556 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.462547 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d403865e-797b-49a6-b37c-1697c377ed77-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.462779 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.462609 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d403865e-797b-49a6-b37c-1697c377ed77-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.462779 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.462636 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d403865e-797b-49a6-b37c-1697c377ed77-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.462779 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.462665 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d403865e-797b-49a6-b37c-1697c377ed77-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.462779 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.462709 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d403865e-797b-49a6-b37c-1697c377ed77-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.563531 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.563477 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d403865e-797b-49a6-b37c-1697c377ed77-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.563531 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.563536 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-965f4\" (UniqueName: \"kubernetes.io/projected/d403865e-797b-49a6-b37c-1697c377ed77-kube-api-access-965f4\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.563802 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.563647 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d403865e-797b-49a6-b37c-1697c377ed77-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.563802 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.563722 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d403865e-797b-49a6-b37c-1697c377ed77-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.563802 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.563750 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d403865e-797b-49a6-b37c-1697c377ed77-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.563802 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.563777 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d403865e-797b-49a6-b37c-1697c377ed77-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.564013 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.563821 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d403865e-797b-49a6-b37c-1697c377ed77-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.564013 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.563896 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d403865e-797b-49a6-b37c-1697c377ed77-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.564013 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.563931 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d403865e-797b-49a6-b37c-1697c377ed77-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.564013 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.563986 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d403865e-797b-49a6-b37c-1697c377ed77-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.564210 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.564099 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d403865e-797b-49a6-b37c-1697c377ed77-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.564293 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.564272 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d403865e-797b-49a6-b37c-1697c377ed77-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.564387 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.564360 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d403865e-797b-49a6-b37c-1697c377ed77-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.564642 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.564619 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d403865e-797b-49a6-b37c-1697c377ed77-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.566231 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.566207 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d403865e-797b-49a6-b37c-1697c377ed77-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.566345 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.566326 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d403865e-797b-49a6-b37c-1697c377ed77-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.575217 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.575186 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:32.576177 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.576152 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-965f4\" (UniqueName: \"kubernetes.io/projected/d403865e-797b-49a6-b37c-1697c377ed77-kube-api-access-965f4\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.576306 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.576285 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d403865e-797b-49a6-b37c-1697c377ed77-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp\" (UID: \"d403865e-797b-49a6-b37c-1697c377ed77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.648890 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.648863 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:32.804769 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.804734 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:23:32.816779 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:32.816751 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp"] Jul 29 19:23:32.822908 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:23:32.822883 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd403865e_797b_49a6_b37c_1697c377ed77.slice/crio-21fe58fe643bf6c2b308f20e2807a047fd92355ad758d1aab0593aab06d74d4c WatchSource:0}: Error finding container 21fe58fe643bf6c2b308f20e2807a047fd92355ad758d1aab0593aab06d74d4c: Status 404 returned error can't find the container with id 21fe58fe643bf6c2b308f20e2807a047fd92355ad758d1aab0593aab06d74d4c Jul 29 19:23:33.564153 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:33.564114 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" event={"ID":"d403865e-797b-49a6-b37c-1697c377ed77","Type":"ContainerStarted","Data":"21fe58fe643bf6c2b308f20e2807a047fd92355ad758d1aab0593aab06d74d4c"} Jul 29 19:23:35.401431 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:35.401389 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:23:35.401831 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:35.401486 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:23:35.401831 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:35.401554 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:23:35.576808 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:35.576774 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" event={"ID":"d403865e-797b-49a6-b37c-1697c377ed77","Type":"ContainerStarted","Data":"6a54ca0d743f0ef00522a7b37d343ff8ae1fc7656946dc9e37f4358976f31a33"} Jul 29 19:23:35.608552 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:35.608487 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" podStartSLOduration=1.032169194 podStartE2EDuration="3.608472211s" totalImagesPullingTime="2.576303017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:23:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:23:35.608069938 +0000 UTC m=+405.496377164" watchObservedRunningTime="2026-07-29 19:23:35.608472211 +0000 UTC m=+405.496779438" Jul 29 19:23:35.649407 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:35.649378 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:36.654359 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:36.654325 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:37.586082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:37.586048 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:23:37.586940 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:23:37.586919 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp" Jul 29 19:24:00.745436 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:00.745397 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:12.808077 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:12.807978 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:12.910023 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:12.909990 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:12.930642 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:12.930616 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8ngn9"] Jul 29 19:24:12.940886 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:12.940860 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8ngn9" Jul 29 19:24:12.942280 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:12.942254 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8ngn9"] Jul 29 19:24:12.943005 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:12.942825 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gfvkm\"" Jul 29 19:24:12.943005 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:12.942850 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 29 19:24:12.943265 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:12.943241 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 29 19:24:12.974065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:12.974037 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:12.976026 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:12.976009 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncp6l\" (UniqueName: \"kubernetes.io/projected/0ff61e21-b7b5-4b00-8ec0-0680cbe97e76-kube-api-access-ncp6l\") pod \"kuadrant-operator-catalog-8ngn9\" (UID: \"0ff61e21-b7b5-4b00-8ec0-0680cbe97e76\") " pod="kuadrant-system/kuadrant-operator-catalog-8ngn9" Jul 29 19:24:13.076810 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:13.076734 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncp6l\" (UniqueName: \"kubernetes.io/projected/0ff61e21-b7b5-4b00-8ec0-0680cbe97e76-kube-api-access-ncp6l\") pod \"kuadrant-operator-catalog-8ngn9\" (UID: \"0ff61e21-b7b5-4b00-8ec0-0680cbe97e76\") " pod="kuadrant-system/kuadrant-operator-catalog-8ngn9" Jul 29 19:24:13.084397 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:13.084373 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncp6l\" (UniqueName: \"kubernetes.io/projected/0ff61e21-b7b5-4b00-8ec0-0680cbe97e76-kube-api-access-ncp6l\") pod \"kuadrant-operator-catalog-8ngn9\" (UID: \"0ff61e21-b7b5-4b00-8ec0-0680cbe97e76\") " pod="kuadrant-system/kuadrant-operator-catalog-8ngn9" Jul 29 19:24:13.253050 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:13.253021 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8ngn9" Jul 29 19:24:13.383179 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:13.383147 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8ngn9"] Jul 29 19:24:13.385638 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:24:13.385608 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff61e21_b7b5_4b00_8ec0_0680cbe97e76.slice/crio-fdd0fde925184e81a3226b649cc158b6366f9499e8fcea8c225f20f3151d408b WatchSource:0}: Error finding container fdd0fde925184e81a3226b649cc158b6366f9499e8fcea8c225f20f3151d408b: Status 404 returned error can't find the container with id fdd0fde925184e81a3226b649cc158b6366f9499e8fcea8c225f20f3151d408b Jul 29 19:24:13.551812 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:13.551774 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8ngn9"] Jul 29 19:24:13.570615 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:13.570583 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s4kdt"] Jul 29 19:24:13.573373 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:13.573354 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s4kdt" Jul 29 19:24:13.582224 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:13.582193 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s4kdt"] Jul 29 19:24:13.681942 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:13.681913 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7pz7\" (UniqueName: \"kubernetes.io/projected/3623f182-5cd8-45f6-be59-3ef1aed2c2ad-kube-api-access-h7pz7\") pod \"kuadrant-operator-catalog-s4kdt\" (UID: \"3623f182-5cd8-45f6-be59-3ef1aed2c2ad\") " pod="kuadrant-system/kuadrant-operator-catalog-s4kdt" Jul 29 19:24:13.728025 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:13.727995 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:13.755385 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:13.755358 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8ngn9" event={"ID":"0ff61e21-b7b5-4b00-8ec0-0680cbe97e76","Type":"ContainerStarted","Data":"fdd0fde925184e81a3226b649cc158b6366f9499e8fcea8c225f20f3151d408b"} Jul 29 19:24:13.782868 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:13.782844 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7pz7\" (UniqueName: \"kubernetes.io/projected/3623f182-5cd8-45f6-be59-3ef1aed2c2ad-kube-api-access-h7pz7\") pod \"kuadrant-operator-catalog-s4kdt\" (UID: \"3623f182-5cd8-45f6-be59-3ef1aed2c2ad\") " pod="kuadrant-system/kuadrant-operator-catalog-s4kdt" Jul 29 19:24:13.790554 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:13.790532 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7pz7\" (UniqueName: \"kubernetes.io/projected/3623f182-5cd8-45f6-be59-3ef1aed2c2ad-kube-api-access-h7pz7\") pod \"kuadrant-operator-catalog-s4kdt\" (UID: \"3623f182-5cd8-45f6-be59-3ef1aed2c2ad\") " pod="kuadrant-system/kuadrant-operator-catalog-s4kdt" Jul 29 19:24:13.883244 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:13.883202 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s4kdt" Jul 29 19:24:13.920790 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:13.920754 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:14.033064 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:14.032837 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s4kdt"] Jul 29 19:24:14.047839 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:24:14.047813 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3623f182_5cd8_45f6_be59_3ef1aed2c2ad.slice/crio-c9e910c807aecd196eb4beff87992e8b263758c8feeb508d2136a46f2257af71 WatchSource:0}: Error finding container c9e910c807aecd196eb4beff87992e8b263758c8feeb508d2136a46f2257af71: Status 404 returned error can't find the container with id c9e910c807aecd196eb4beff87992e8b263758c8feeb508d2136a46f2257af71 Jul 29 19:24:14.762122 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:14.762086 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s4kdt" event={"ID":"3623f182-5cd8-45f6-be59-3ef1aed2c2ad","Type":"ContainerStarted","Data":"c9e910c807aecd196eb4beff87992e8b263758c8feeb508d2136a46f2257af71"} Jul 29 19:24:15.768499 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:15.768460 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s4kdt" event={"ID":"3623f182-5cd8-45f6-be59-3ef1aed2c2ad","Type":"ContainerStarted","Data":"50f9502eaaa9bdd76f8ff99e87be4df9ee72853ff36201ea0cddf953ff4af84d"} Jul 29 19:24:15.770307 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:15.770281 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8ngn9" event={"ID":"0ff61e21-b7b5-4b00-8ec0-0680cbe97e76","Type":"ContainerStarted","Data":"7230bf1835c68609f9d38f7ee3762a6ddd1a5b2f609f95e552a3506a87a481dc"} Jul 29 19:24:15.770425 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:15.770371 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8ngn9" podUID="0ff61e21-b7b5-4b00-8ec0-0680cbe97e76" containerName="registry-server" containerID="cri-o://7230bf1835c68609f9d38f7ee3762a6ddd1a5b2f609f95e552a3506a87a481dc" gracePeriod=2 Jul 29 19:24:15.784881 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:15.784826 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-s4kdt" podStartSLOduration=1.30000437 podStartE2EDuration="2.784807026s" totalImagesPullingTime="1.484802656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:15.782770774 +0000 UTC m=+445.671078002" watchObservedRunningTime="2026-07-29 19:24:15.784807026 +0000 UTC m=+445.673114265" Jul 29 19:24:15.799881 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:15.799841 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8ngn9" podStartSLOduration=1.655259369 podStartE2EDuration="3.79982866s" totalImagesPullingTime="2.144569291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:15.798574544 +0000 UTC m=+445.686881773" watchObservedRunningTime="2026-07-29 19:24:15.79982866 +0000 UTC m=+445.688135915" Jul 29 19:24:16.011410 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:16.011384 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8ngn9" Jul 29 19:24:16.101805 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:16.101722 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncp6l\" (UniqueName: \"kubernetes.io/projected/0ff61e21-b7b5-4b00-8ec0-0680cbe97e76-kube-api-access-ncp6l\") pod \"0ff61e21-b7b5-4b00-8ec0-0680cbe97e76\" (UID: \"0ff61e21-b7b5-4b00-8ec0-0680cbe97e76\") " Jul 29 19:24:16.103849 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:16.103824 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ff61e21-b7b5-4b00-8ec0-0680cbe97e76-kube-api-access-ncp6l" (OuterVolumeSpecName: "kube-api-access-ncp6l") pod "0ff61e21-b7b5-4b00-8ec0-0680cbe97e76" (UID: "0ff61e21-b7b5-4b00-8ec0-0680cbe97e76"). InnerVolumeSpecName "kube-api-access-ncp6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:24:16.202605 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:16.202574 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncp6l\" (UniqueName: \"kubernetes.io/projected/0ff61e21-b7b5-4b00-8ec0-0680cbe97e76-kube-api-access-ncp6l\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:24:16.776407 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:16.776371 2574 generic.go:356] "Generic (PLEG): container finished" podID="0ff61e21-b7b5-4b00-8ec0-0680cbe97e76" containerID="7230bf1835c68609f9d38f7ee3762a6ddd1a5b2f609f95e552a3506a87a481dc" exitCode=0 Jul 29 19:24:16.776855 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:16.776430 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8ngn9" Jul 29 19:24:16.776855 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:16.776458 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8ngn9" event={"ID":"0ff61e21-b7b5-4b00-8ec0-0680cbe97e76","Type":"ContainerDied","Data":"7230bf1835c68609f9d38f7ee3762a6ddd1a5b2f609f95e552a3506a87a481dc"} Jul 29 19:24:16.776855 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:16.776531 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8ngn9" event={"ID":"0ff61e21-b7b5-4b00-8ec0-0680cbe97e76","Type":"ContainerDied","Data":"fdd0fde925184e81a3226b649cc158b6366f9499e8fcea8c225f20f3151d408b"} Jul 29 19:24:16.776855 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:16.776557 2574 scope.go:117] "RemoveContainer" containerID="7230bf1835c68609f9d38f7ee3762a6ddd1a5b2f609f95e552a3506a87a481dc" Jul 29 19:24:16.785402 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:16.785381 2574 scope.go:117] "RemoveContainer" containerID="7230bf1835c68609f9d38f7ee3762a6ddd1a5b2f609f95e552a3506a87a481dc" Jul 29 19:24:16.785677 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:24:16.785657 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7230bf1835c68609f9d38f7ee3762a6ddd1a5b2f609f95e552a3506a87a481dc\": container with ID starting with 7230bf1835c68609f9d38f7ee3762a6ddd1a5b2f609f95e552a3506a87a481dc not found: ID does not exist" containerID="7230bf1835c68609f9d38f7ee3762a6ddd1a5b2f609f95e552a3506a87a481dc" Jul 29 19:24:16.785757 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:16.785684 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7230bf1835c68609f9d38f7ee3762a6ddd1a5b2f609f95e552a3506a87a481dc"} err="failed to get container status \"7230bf1835c68609f9d38f7ee3762a6ddd1a5b2f609f95e552a3506a87a481dc\": rpc error: code = NotFound desc = could not find container \"7230bf1835c68609f9d38f7ee3762a6ddd1a5b2f609f95e552a3506a87a481dc\": container with ID starting with 7230bf1835c68609f9d38f7ee3762a6ddd1a5b2f609f95e552a3506a87a481dc not found: ID does not exist" Jul 29 19:24:16.790599 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:16.790578 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8ngn9"] Jul 29 19:24:16.794439 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:16.794418 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8ngn9"] Jul 29 19:24:18.095296 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:18.095266 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:18.733318 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:18.733284 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ff61e21-b7b5-4b00-8ec0-0680cbe97e76" path="/var/lib/kubelet/pods/0ff61e21-b7b5-4b00-8ec0-0680cbe97e76/volumes" Jul 29 19:24:20.044959 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:20.044925 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:20.146323 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:20.146283 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:23.884278 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:23.884243 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-s4kdt" Jul 29 19:24:23.884685 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:23.884294 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-s4kdt" Jul 29 19:24:23.905834 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:23.905811 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-s4kdt" Jul 29 19:24:24.834031 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:24.834004 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-s4kdt" Jul 29 19:24:28.533928 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.533896 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb"] Jul 29 19:24:28.534300 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.534234 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ff61e21-b7b5-4b00-8ec0-0680cbe97e76" containerName="registry-server" Jul 29 19:24:28.534300 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.534245 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ff61e21-b7b5-4b00-8ec0-0680cbe97e76" containerName="registry-server" Jul 29 19:24:28.534370 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.534312 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ff61e21-b7b5-4b00-8ec0-0680cbe97e76" containerName="registry-server" Jul 29 19:24:28.538732 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.538715 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" Jul 29 19:24:28.540811 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.540789 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-shqcg\"" Jul 29 19:24:28.544947 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.544921 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb"] Jul 29 19:24:28.606317 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.606290 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d56327e-9d90-45ef-93ba-e927ccbef7b2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb\" (UID: \"8d56327e-9d90-45ef-93ba-e927ccbef7b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" Jul 29 19:24:28.606429 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.606324 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjt9w\" (UniqueName: \"kubernetes.io/projected/8d56327e-9d90-45ef-93ba-e927ccbef7b2-kube-api-access-sjt9w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb\" (UID: \"8d56327e-9d90-45ef-93ba-e927ccbef7b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" Jul 29 19:24:28.606429 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.606352 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d56327e-9d90-45ef-93ba-e927ccbef7b2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb\" (UID: \"8d56327e-9d90-45ef-93ba-e927ccbef7b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" Jul 29 19:24:28.706683 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.706658 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d56327e-9d90-45ef-93ba-e927ccbef7b2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb\" (UID: \"8d56327e-9d90-45ef-93ba-e927ccbef7b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" Jul 29 19:24:28.706804 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.706743 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d56327e-9d90-45ef-93ba-e927ccbef7b2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb\" (UID: \"8d56327e-9d90-45ef-93ba-e927ccbef7b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" Jul 29 19:24:28.706804 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.706770 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjt9w\" (UniqueName: \"kubernetes.io/projected/8d56327e-9d90-45ef-93ba-e927ccbef7b2-kube-api-access-sjt9w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb\" (UID: \"8d56327e-9d90-45ef-93ba-e927ccbef7b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" Jul 29 19:24:28.707047 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.707025 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d56327e-9d90-45ef-93ba-e927ccbef7b2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb\" (UID: \"8d56327e-9d90-45ef-93ba-e927ccbef7b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" Jul 29 19:24:28.707158 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.707071 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d56327e-9d90-45ef-93ba-e927ccbef7b2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb\" (UID: \"8d56327e-9d90-45ef-93ba-e927ccbef7b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" Jul 29 19:24:28.715558 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.715532 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjt9w\" (UniqueName: \"kubernetes.io/projected/8d56327e-9d90-45ef-93ba-e927ccbef7b2-kube-api-access-sjt9w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb\" (UID: \"8d56327e-9d90-45ef-93ba-e927ccbef7b2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" Jul 29 19:24:28.849109 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.849035 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" Jul 29 19:24:28.973657 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:28.973632 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb"] Jul 29 19:24:28.975484 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:24:28.975457 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d56327e_9d90_45ef_93ba_e927ccbef7b2.slice/crio-275681dac7eb54e78228b04164223a1bc8039fccfa96daa82a4bde092e1c06d0 WatchSource:0}: Error finding container 275681dac7eb54e78228b04164223a1bc8039fccfa96daa82a4bde092e1c06d0: Status 404 returned error can't find the container with id 275681dac7eb54e78228b04164223a1bc8039fccfa96daa82a4bde092e1c06d0 Jul 29 19:24:29.132663 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.132598 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx"] Jul 29 19:24:29.135949 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.135930 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" Jul 29 19:24:29.144478 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.144451 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx"] Jul 29 19:24:29.211665 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.211635 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b30f211-c488-453d-89bb-e814ebda2766-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx\" (UID: \"8b30f211-c488-453d-89bb-e814ebda2766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" Jul 29 19:24:29.211806 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.211672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhtct\" (UniqueName: \"kubernetes.io/projected/8b30f211-c488-453d-89bb-e814ebda2766-kube-api-access-lhtct\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx\" (UID: \"8b30f211-c488-453d-89bb-e814ebda2766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" Jul 29 19:24:29.211806 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.211701 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b30f211-c488-453d-89bb-e814ebda2766-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx\" (UID: \"8b30f211-c488-453d-89bb-e814ebda2766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" Jul 29 19:24:29.312123 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.312088 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b30f211-c488-453d-89bb-e814ebda2766-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx\" (UID: \"8b30f211-c488-453d-89bb-e814ebda2766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" Jul 29 19:24:29.312277 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.312174 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b30f211-c488-453d-89bb-e814ebda2766-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx\" (UID: \"8b30f211-c488-453d-89bb-e814ebda2766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" Jul 29 19:24:29.312277 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.312199 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhtct\" (UniqueName: \"kubernetes.io/projected/8b30f211-c488-453d-89bb-e814ebda2766-kube-api-access-lhtct\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx\" (UID: \"8b30f211-c488-453d-89bb-e814ebda2766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" Jul 29 19:24:29.312453 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.312435 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b30f211-c488-453d-89bb-e814ebda2766-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx\" (UID: \"8b30f211-c488-453d-89bb-e814ebda2766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" Jul 29 19:24:29.312495 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.312473 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b30f211-c488-453d-89bb-e814ebda2766-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx\" (UID: \"8b30f211-c488-453d-89bb-e814ebda2766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" Jul 29 19:24:29.320740 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.320715 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhtct\" (UniqueName: \"kubernetes.io/projected/8b30f211-c488-453d-89bb-e814ebda2766-kube-api-access-lhtct\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx\" (UID: \"8b30f211-c488-453d-89bb-e814ebda2766\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" Jul 29 19:24:29.444605 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.444571 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" Jul 29 19:24:29.573553 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.573339 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx"] Jul 29 19:24:29.576121 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:24:29.576096 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b30f211_c488_453d_89bb_e814ebda2766.slice/crio-04580fd694a1a9046cc6242b7414d0f5c87e94fc95fe140d007e99177ad1a0bc WatchSource:0}: Error finding container 04580fd694a1a9046cc6242b7414d0f5c87e94fc95fe140d007e99177ad1a0bc: Status 404 returned error can't find the container with id 04580fd694a1a9046cc6242b7414d0f5c87e94fc95fe140d007e99177ad1a0bc Jul 29 19:24:29.733914 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.733880 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb"] Jul 29 19:24:29.737279 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.737263 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" Jul 29 19:24:29.747502 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.747478 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb"] Jul 29 19:24:29.816083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.816052 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb\" (UID: \"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" Jul 29 19:24:29.816268 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.816100 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb\" (UID: \"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" Jul 29 19:24:29.816268 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.816161 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdpc8\" (UniqueName: \"kubernetes.io/projected/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-kube-api-access-tdpc8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb\" (UID: \"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" Jul 29 19:24:29.836361 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.836327 2574 generic.go:356] "Generic (PLEG): container finished" podID="8d56327e-9d90-45ef-93ba-e927ccbef7b2" containerID="7d04f6296da6cc1c4c9f4650422bccd3df893ec9abfdb1986a35e7af3a82269e" exitCode=0 Jul 29 19:24:29.836494 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.836412 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" event={"ID":"8d56327e-9d90-45ef-93ba-e927ccbef7b2","Type":"ContainerDied","Data":"7d04f6296da6cc1c4c9f4650422bccd3df893ec9abfdb1986a35e7af3a82269e"} Jul 29 19:24:29.836494 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.836463 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" event={"ID":"8d56327e-9d90-45ef-93ba-e927ccbef7b2","Type":"ContainerStarted","Data":"275681dac7eb54e78228b04164223a1bc8039fccfa96daa82a4bde092e1c06d0"} Jul 29 19:24:29.837980 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.837957 2574 generic.go:356] "Generic (PLEG): container finished" podID="8b30f211-c488-453d-89bb-e814ebda2766" containerID="57b9fd50e1e890c1c3195c9f70cfee70edf6432c1ee559721f8f8cbb5f3e632f" exitCode=0 Jul 29 19:24:29.838095 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.838032 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" event={"ID":"8b30f211-c488-453d-89bb-e814ebda2766","Type":"ContainerDied","Data":"57b9fd50e1e890c1c3195c9f70cfee70edf6432c1ee559721f8f8cbb5f3e632f"} Jul 29 19:24:29.838095 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.838072 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" event={"ID":"8b30f211-c488-453d-89bb-e814ebda2766","Type":"ContainerStarted","Data":"04580fd694a1a9046cc6242b7414d0f5c87e94fc95fe140d007e99177ad1a0bc"} Jul 29 19:24:29.917238 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.917202 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb\" (UID: \"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" Jul 29 19:24:29.917385 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.917254 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdpc8\" (UniqueName: \"kubernetes.io/projected/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-kube-api-access-tdpc8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb\" (UID: \"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" Jul 29 19:24:29.917385 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.917356 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb\" (UID: \"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" Jul 29 19:24:29.917695 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.917671 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb\" (UID: \"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" Jul 29 19:24:29.917695 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.917685 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb\" (UID: \"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" Jul 29 19:24:29.925291 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:29.925269 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdpc8\" (UniqueName: \"kubernetes.io/projected/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-kube-api-access-tdpc8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb\" (UID: \"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" Jul 29 19:24:30.046271 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.046188 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" Jul 29 19:24:30.137281 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.137252 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv"] Jul 29 19:24:30.145861 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.145834 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" Jul 29 19:24:30.151014 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.150987 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv"] Jul 29 19:24:30.177086 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.177067 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb"] Jul 29 19:24:30.179240 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:24:30.179215 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35289aa7_bf76_4ec3_8a87_b60fbbc9abb8.slice/crio-b38c2d919aed172bc81daafdd47e78539b38742144bef70024628d8a8c1d0edf WatchSource:0}: Error finding container b38c2d919aed172bc81daafdd47e78539b38742144bef70024628d8a8c1d0edf: Status 404 returned error can't find the container with id b38c2d919aed172bc81daafdd47e78539b38742144bef70024628d8a8c1d0edf Jul 29 19:24:30.220232 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.220205 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27dab636-bc58-4414-b441-8d96611a44d8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv\" (UID: \"27dab636-bc58-4414-b441-8d96611a44d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" Jul 29 19:24:30.220329 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.220249 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn6np\" (UniqueName: \"kubernetes.io/projected/27dab636-bc58-4414-b441-8d96611a44d8-kube-api-access-bn6np\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv\" (UID: \"27dab636-bc58-4414-b441-8d96611a44d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" Jul 29 19:24:30.220329 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.220269 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27dab636-bc58-4414-b441-8d96611a44d8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv\" (UID: \"27dab636-bc58-4414-b441-8d96611a44d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" Jul 29 19:24:30.321609 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.321548 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27dab636-bc58-4414-b441-8d96611a44d8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv\" (UID: \"27dab636-bc58-4414-b441-8d96611a44d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" Jul 29 19:24:30.321609 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.321602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn6np\" (UniqueName: \"kubernetes.io/projected/27dab636-bc58-4414-b441-8d96611a44d8-kube-api-access-bn6np\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv\" (UID: \"27dab636-bc58-4414-b441-8d96611a44d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" Jul 29 19:24:30.321745 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.321622 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27dab636-bc58-4414-b441-8d96611a44d8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv\" (UID: \"27dab636-bc58-4414-b441-8d96611a44d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" Jul 29 19:24:30.321889 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.321871 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27dab636-bc58-4414-b441-8d96611a44d8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv\" (UID: \"27dab636-bc58-4414-b441-8d96611a44d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" Jul 29 19:24:30.321931 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.321915 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27dab636-bc58-4414-b441-8d96611a44d8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv\" (UID: \"27dab636-bc58-4414-b441-8d96611a44d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" Jul 29 19:24:30.330084 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.330066 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn6np\" (UniqueName: \"kubernetes.io/projected/27dab636-bc58-4414-b441-8d96611a44d8-kube-api-access-bn6np\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv\" (UID: \"27dab636-bc58-4414-b441-8d96611a44d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" Jul 29 19:24:30.457321 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.457288 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" Jul 29 19:24:30.605072 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.605048 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv"] Jul 29 19:24:30.607745 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:24:30.607716 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27dab636_bc58_4414_b441_8d96611a44d8.slice/crio-556ef65fb27dbbcb521f04971938c86246777437cf429018dce8ed42e3a16d5a WatchSource:0}: Error finding container 556ef65fb27dbbcb521f04971938c86246777437cf429018dce8ed42e3a16d5a: Status 404 returned error can't find the container with id 556ef65fb27dbbcb521f04971938c86246777437cf429018dce8ed42e3a16d5a Jul 29 19:24:30.844665 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.844579 2574 generic.go:356] "Generic (PLEG): container finished" podID="27dab636-bc58-4414-b441-8d96611a44d8" containerID="d948bb6dbd95ec31b7290724047654f6a4fbb1b995c447b42712d394acf26817" exitCode=0 Jul 29 19:24:30.844808 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.844669 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" event={"ID":"27dab636-bc58-4414-b441-8d96611a44d8","Type":"ContainerDied","Data":"d948bb6dbd95ec31b7290724047654f6a4fbb1b995c447b42712d394acf26817"} Jul 29 19:24:30.844808 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.844729 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" event={"ID":"27dab636-bc58-4414-b441-8d96611a44d8","Type":"ContainerStarted","Data":"556ef65fb27dbbcb521f04971938c86246777437cf429018dce8ed42e3a16d5a"} Jul 29 19:24:30.846529 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.846481 2574 generic.go:356] "Generic (PLEG): container finished" podID="8d56327e-9d90-45ef-93ba-e927ccbef7b2" containerID="d8c73739fa4b9f6334ce9f92bf3af300f0b7aefdbaa044aa5b4cbaa1ca2439c9" exitCode=0 Jul 29 19:24:30.846642 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.846542 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" event={"ID":"8d56327e-9d90-45ef-93ba-e927ccbef7b2","Type":"ContainerDied","Data":"d8c73739fa4b9f6334ce9f92bf3af300f0b7aefdbaa044aa5b4cbaa1ca2439c9"} Jul 29 19:24:30.848213 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.848193 2574 generic.go:356] "Generic (PLEG): container finished" podID="35289aa7-bf76-4ec3-8a87-b60fbbc9abb8" containerID="785e6c9b3bd9eeb6b1b5575ca50eccb70b41bf7ce5fd6124b636b3e0f9c6349f" exitCode=0 Jul 29 19:24:30.848297 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.848256 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" event={"ID":"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8","Type":"ContainerDied","Data":"785e6c9b3bd9eeb6b1b5575ca50eccb70b41bf7ce5fd6124b636b3e0f9c6349f"} Jul 29 19:24:30.848346 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:30.848307 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" event={"ID":"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8","Type":"ContainerStarted","Data":"b38c2d919aed172bc81daafdd47e78539b38742144bef70024628d8a8c1d0edf"} Jul 29 19:24:31.856216 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:31.856146 2574 generic.go:356] "Generic (PLEG): container finished" podID="8d56327e-9d90-45ef-93ba-e927ccbef7b2" containerID="28ad741d4258b8ebd4f7b39fe347b4201260861d1a6a3671741cff675387f4a9" exitCode=0 Jul 29 19:24:31.856647 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:31.856224 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" event={"ID":"8d56327e-9d90-45ef-93ba-e927ccbef7b2","Type":"ContainerDied","Data":"28ad741d4258b8ebd4f7b39fe347b4201260861d1a6a3671741cff675387f4a9"} Jul 29 19:24:31.858039 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:31.858017 2574 generic.go:356] "Generic (PLEG): container finished" podID="35289aa7-bf76-4ec3-8a87-b60fbbc9abb8" containerID="9f51f7c493d7e3be7c87333b7404fe4cdd88f84ab74bf9eee906646827ea57ee" exitCode=0 Jul 29 19:24:31.858146 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:31.858110 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" event={"ID":"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8","Type":"ContainerDied","Data":"9f51f7c493d7e3be7c87333b7404fe4cdd88f84ab74bf9eee906646827ea57ee"} Jul 29 19:24:31.859917 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:31.859894 2574 generic.go:356] "Generic (PLEG): container finished" podID="8b30f211-c488-453d-89bb-e814ebda2766" containerID="03f16091e829989fcd6b4dab6f51732053df7d3a0eef6f46941ef097a6bbdb7d" exitCode=0 Jul 29 19:24:31.860011 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:31.859977 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" event={"ID":"8b30f211-c488-453d-89bb-e814ebda2766","Type":"ContainerDied","Data":"03f16091e829989fcd6b4dab6f51732053df7d3a0eef6f46941ef097a6bbdb7d"} Jul 29 19:24:31.861877 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:31.861855 2574 generic.go:356] "Generic (PLEG): container finished" podID="27dab636-bc58-4414-b441-8d96611a44d8" containerID="686614d7c3f66803a237477feee58570bd0e6dc4283da18d05d753ee1378e9e7" exitCode=0 Jul 29 19:24:31.861952 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:31.861900 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" event={"ID":"27dab636-bc58-4414-b441-8d96611a44d8","Type":"ContainerDied","Data":"686614d7c3f66803a237477feee58570bd0e6dc4283da18d05d753ee1378e9e7"} Jul 29 19:24:32.868364 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:32.868322 2574 generic.go:356] "Generic (PLEG): container finished" podID="27dab636-bc58-4414-b441-8d96611a44d8" containerID="9f94c0c4a00fd995997820280b0b9b483004b08060cc9e3ac50ffa57c13494e4" exitCode=0 Jul 29 19:24:32.868798 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:32.868389 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" event={"ID":"27dab636-bc58-4414-b441-8d96611a44d8","Type":"ContainerDied","Data":"9f94c0c4a00fd995997820280b0b9b483004b08060cc9e3ac50ffa57c13494e4"} Jul 29 19:24:32.870501 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:32.870479 2574 generic.go:356] "Generic (PLEG): container finished" podID="35289aa7-bf76-4ec3-8a87-b60fbbc9abb8" containerID="4de6c93b856e3f1abc14006b7f84f1ed016797aa98b24eaadab370e46e0609c9" exitCode=0 Jul 29 19:24:32.870633 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:32.870540 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" event={"ID":"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8","Type":"ContainerDied","Data":"4de6c93b856e3f1abc14006b7f84f1ed016797aa98b24eaadab370e46e0609c9"} Jul 29 19:24:32.872496 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:32.872479 2574 generic.go:356] "Generic (PLEG): container finished" podID="8b30f211-c488-453d-89bb-e814ebda2766" containerID="26d58e1302cadb76efc095b6d98294c07122bad862b98a0b1101123512ca8897" exitCode=0 Jul 29 19:24:32.872583 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:32.872542 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" event={"ID":"8b30f211-c488-453d-89bb-e814ebda2766","Type":"ContainerDied","Data":"26d58e1302cadb76efc095b6d98294c07122bad862b98a0b1101123512ca8897"} Jul 29 19:24:33.002565 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:33.002544 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" Jul 29 19:24:33.144565 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:33.144532 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d56327e-9d90-45ef-93ba-e927ccbef7b2-util\") pod \"8d56327e-9d90-45ef-93ba-e927ccbef7b2\" (UID: \"8d56327e-9d90-45ef-93ba-e927ccbef7b2\") " Jul 29 19:24:33.144726 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:33.144571 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjt9w\" (UniqueName: \"kubernetes.io/projected/8d56327e-9d90-45ef-93ba-e927ccbef7b2-kube-api-access-sjt9w\") pod \"8d56327e-9d90-45ef-93ba-e927ccbef7b2\" (UID: \"8d56327e-9d90-45ef-93ba-e927ccbef7b2\") " Jul 29 19:24:33.144726 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:33.144594 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d56327e-9d90-45ef-93ba-e927ccbef7b2-bundle\") pod \"8d56327e-9d90-45ef-93ba-e927ccbef7b2\" (UID: \"8d56327e-9d90-45ef-93ba-e927ccbef7b2\") " Jul 29 19:24:33.145146 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:33.145111 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d56327e-9d90-45ef-93ba-e927ccbef7b2-bundle" (OuterVolumeSpecName: "bundle") pod "8d56327e-9d90-45ef-93ba-e927ccbef7b2" (UID: "8d56327e-9d90-45ef-93ba-e927ccbef7b2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:24:33.146729 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:33.146708 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d56327e-9d90-45ef-93ba-e927ccbef7b2-kube-api-access-sjt9w" (OuterVolumeSpecName: "kube-api-access-sjt9w") pod "8d56327e-9d90-45ef-93ba-e927ccbef7b2" (UID: "8d56327e-9d90-45ef-93ba-e927ccbef7b2"). InnerVolumeSpecName "kube-api-access-sjt9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:24:33.150267 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:33.150245 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d56327e-9d90-45ef-93ba-e927ccbef7b2-util" (OuterVolumeSpecName: "util") pod "8d56327e-9d90-45ef-93ba-e927ccbef7b2" (UID: "8d56327e-9d90-45ef-93ba-e927ccbef7b2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:24:33.245226 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:33.245201 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d56327e-9d90-45ef-93ba-e927ccbef7b2-bundle\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:24:33.245226 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:33.245222 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d56327e-9d90-45ef-93ba-e927ccbef7b2-util\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:24:33.245363 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:33.245231 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjt9w\" (UniqueName: \"kubernetes.io/projected/8d56327e-9d90-45ef-93ba-e927ccbef7b2-kube-api-access-sjt9w\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:24:33.879728 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:33.879693 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" Jul 29 19:24:33.880094 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:33.879744 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb" event={"ID":"8d56327e-9d90-45ef-93ba-e927ccbef7b2","Type":"ContainerDied","Data":"275681dac7eb54e78228b04164223a1bc8039fccfa96daa82a4bde092e1c06d0"} Jul 29 19:24:33.880094 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:33.879787 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="275681dac7eb54e78228b04164223a1bc8039fccfa96daa82a4bde092e1c06d0" Jul 29 19:24:34.022460 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.022432 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" Jul 29 19:24:34.062924 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.062900 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" Jul 29 19:24:34.065777 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.065750 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" Jul 29 19:24:34.152149 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.152122 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-util\") pod \"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8\" (UID: \"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8\") " Jul 29 19:24:34.152326 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.152154 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdpc8\" (UniqueName: \"kubernetes.io/projected/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-kube-api-access-tdpc8\") pod \"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8\" (UID: \"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8\") " Jul 29 19:24:34.152326 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.152173 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhtct\" (UniqueName: \"kubernetes.io/projected/8b30f211-c488-453d-89bb-e814ebda2766-kube-api-access-lhtct\") pod \"8b30f211-c488-453d-89bb-e814ebda2766\" (UID: \"8b30f211-c488-453d-89bb-e814ebda2766\") " Jul 29 19:24:34.152326 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.152225 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27dab636-bc58-4414-b441-8d96611a44d8-bundle\") pod \"27dab636-bc58-4414-b441-8d96611a44d8\" (UID: \"27dab636-bc58-4414-b441-8d96611a44d8\") " Jul 29 19:24:34.152326 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.152311 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b30f211-c488-453d-89bb-e814ebda2766-bundle\") pod \"8b30f211-c488-453d-89bb-e814ebda2766\" (UID: \"8b30f211-c488-453d-89bb-e814ebda2766\") " Jul 29 19:24:34.153629 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.152335 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27dab636-bc58-4414-b441-8d96611a44d8-util\") pod \"27dab636-bc58-4414-b441-8d96611a44d8\" (UID: \"27dab636-bc58-4414-b441-8d96611a44d8\") " Jul 29 19:24:34.153629 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.152376 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b30f211-c488-453d-89bb-e814ebda2766-util\") pod \"8b30f211-c488-453d-89bb-e814ebda2766\" (UID: \"8b30f211-c488-453d-89bb-e814ebda2766\") " Jul 29 19:24:34.153629 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.152402 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bn6np\" (UniqueName: \"kubernetes.io/projected/27dab636-bc58-4414-b441-8d96611a44d8-kube-api-access-bn6np\") pod \"27dab636-bc58-4414-b441-8d96611a44d8\" (UID: \"27dab636-bc58-4414-b441-8d96611a44d8\") " Jul 29 19:24:34.153629 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.152436 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-bundle\") pod \"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8\" (UID: \"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8\") " Jul 29 19:24:34.153629 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.153001 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b30f211-c488-453d-89bb-e814ebda2766-bundle" (OuterVolumeSpecName: "bundle") pod "8b30f211-c488-453d-89bb-e814ebda2766" (UID: "8b30f211-c488-453d-89bb-e814ebda2766"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:24:34.153629 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.153180 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27dab636-bc58-4414-b441-8d96611a44d8-bundle" (OuterVolumeSpecName: "bundle") pod "27dab636-bc58-4414-b441-8d96611a44d8" (UID: "27dab636-bc58-4414-b441-8d96611a44d8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:24:34.153629 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.153378 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-bundle" (OuterVolumeSpecName: "bundle") pod "35289aa7-bf76-4ec3-8a87-b60fbbc9abb8" (UID: "35289aa7-bf76-4ec3-8a87-b60fbbc9abb8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:24:34.154752 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.154710 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-kube-api-access-tdpc8" (OuterVolumeSpecName: "kube-api-access-tdpc8") pod "35289aa7-bf76-4ec3-8a87-b60fbbc9abb8" (UID: "35289aa7-bf76-4ec3-8a87-b60fbbc9abb8"). InnerVolumeSpecName "kube-api-access-tdpc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:24:34.154834 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.154799 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b30f211-c488-453d-89bb-e814ebda2766-kube-api-access-lhtct" (OuterVolumeSpecName: "kube-api-access-lhtct") pod "8b30f211-c488-453d-89bb-e814ebda2766" (UID: "8b30f211-c488-453d-89bb-e814ebda2766"). InnerVolumeSpecName "kube-api-access-lhtct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:24:34.155261 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.155241 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27dab636-bc58-4414-b441-8d96611a44d8-kube-api-access-bn6np" (OuterVolumeSpecName: "kube-api-access-bn6np") pod "27dab636-bc58-4414-b441-8d96611a44d8" (UID: "27dab636-bc58-4414-b441-8d96611a44d8"). InnerVolumeSpecName "kube-api-access-bn6np". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:24:34.158306 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.158282 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27dab636-bc58-4414-b441-8d96611a44d8-util" (OuterVolumeSpecName: "util") pod "27dab636-bc58-4414-b441-8d96611a44d8" (UID: "27dab636-bc58-4414-b441-8d96611a44d8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:24:34.158923 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.158900 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b30f211-c488-453d-89bb-e814ebda2766-util" (OuterVolumeSpecName: "util") pod "8b30f211-c488-453d-89bb-e814ebda2766" (UID: "8b30f211-c488-453d-89bb-e814ebda2766"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:24:34.158972 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.158932 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-util" (OuterVolumeSpecName: "util") pod "35289aa7-bf76-4ec3-8a87-b60fbbc9abb8" (UID: "35289aa7-bf76-4ec3-8a87-b60fbbc9abb8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:24:34.253506 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.253459 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27dab636-bc58-4414-b441-8d96611a44d8-bundle\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:24:34.253506 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.253501 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b30f211-c488-453d-89bb-e814ebda2766-bundle\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:24:34.253506 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.253530 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27dab636-bc58-4414-b441-8d96611a44d8-util\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:24:34.253721 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.253539 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b30f211-c488-453d-89bb-e814ebda2766-util\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:24:34.253721 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.253547 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bn6np\" (UniqueName: \"kubernetes.io/projected/27dab636-bc58-4414-b441-8d96611a44d8-kube-api-access-bn6np\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:24:34.253721 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.253556 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-bundle\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:24:34.253721 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.253564 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-util\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:24:34.253721 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.253571 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdpc8\" (UniqueName: \"kubernetes.io/projected/35289aa7-bf76-4ec3-8a87-b60fbbc9abb8-kube-api-access-tdpc8\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:24:34.253721 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.253579 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhtct\" (UniqueName: \"kubernetes.io/projected/8b30f211-c488-453d-89bb-e814ebda2766-kube-api-access-lhtct\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:24:34.886671 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.886640 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" Jul 29 19:24:34.887076 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.886640 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb" event={"ID":"35289aa7-bf76-4ec3-8a87-b60fbbc9abb8","Type":"ContainerDied","Data":"b38c2d919aed172bc81daafdd47e78539b38742144bef70024628d8a8c1d0edf"} Jul 29 19:24:34.887076 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.886785 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b38c2d919aed172bc81daafdd47e78539b38742144bef70024628d8a8c1d0edf" Jul 29 19:24:34.888801 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.888760 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" Jul 29 19:24:34.888801 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.888788 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx" event={"ID":"8b30f211-c488-453d-89bb-e814ebda2766","Type":"ContainerDied","Data":"04580fd694a1a9046cc6242b7414d0f5c87e94fc95fe140d007e99177ad1a0bc"} Jul 29 19:24:34.889054 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.888828 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04580fd694a1a9046cc6242b7414d0f5c87e94fc95fe140d007e99177ad1a0bc" Jul 29 19:24:34.891116 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.891095 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" event={"ID":"27dab636-bc58-4414-b441-8d96611a44d8","Type":"ContainerDied","Data":"556ef65fb27dbbcb521f04971938c86246777437cf429018dce8ed42e3a16d5a"} Jul 29 19:24:34.891229 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.891128 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv" Jul 29 19:24:34.891229 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:34.891129 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="556ef65fb27dbbcb521f04971938c86246777437cf429018dce8ed42e3a16d5a" Jul 29 19:24:36.391339 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:36.391300 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:39.031959 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.031920 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp"] Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032231 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35289aa7-bf76-4ec3-8a87-b60fbbc9abb8" containerName="util" Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032241 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="35289aa7-bf76-4ec3-8a87-b60fbbc9abb8" containerName="util" Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032249 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b30f211-c488-453d-89bb-e814ebda2766" containerName="extract" Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032255 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b30f211-c488-453d-89bb-e814ebda2766" containerName="extract" Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032267 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d56327e-9d90-45ef-93ba-e927ccbef7b2" containerName="util" Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032274 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d56327e-9d90-45ef-93ba-e927ccbef7b2" containerName="util" Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032280 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35289aa7-bf76-4ec3-8a87-b60fbbc9abb8" containerName="extract" Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032286 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="35289aa7-bf76-4ec3-8a87-b60fbbc9abb8" containerName="extract" Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032298 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d56327e-9d90-45ef-93ba-e927ccbef7b2" containerName="pull" Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032303 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d56327e-9d90-45ef-93ba-e927ccbef7b2" containerName="pull" Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032308 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27dab636-bc58-4414-b441-8d96611a44d8" containerName="pull" Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032313 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="27dab636-bc58-4414-b441-8d96611a44d8" containerName="pull" Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032320 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35289aa7-bf76-4ec3-8a87-b60fbbc9abb8" containerName="pull" Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032324 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="35289aa7-bf76-4ec3-8a87-b60fbbc9abb8" containerName="pull" Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032329 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27dab636-bc58-4414-b441-8d96611a44d8" containerName="extract" Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032335 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="27dab636-bc58-4414-b441-8d96611a44d8" containerName="extract" Jul 29 19:24:39.032336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032343 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d56327e-9d90-45ef-93ba-e927ccbef7b2" containerName="extract" Jul 29 19:24:39.032828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032348 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d56327e-9d90-45ef-93ba-e927ccbef7b2" containerName="extract" Jul 29 19:24:39.032828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032353 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b30f211-c488-453d-89bb-e814ebda2766" containerName="pull" Jul 29 19:24:39.032828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032358 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b30f211-c488-453d-89bb-e814ebda2766" containerName="pull" Jul 29 19:24:39.032828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032364 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27dab636-bc58-4414-b441-8d96611a44d8" containerName="util" Jul 29 19:24:39.032828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032368 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="27dab636-bc58-4414-b441-8d96611a44d8" containerName="util" Jul 29 19:24:39.032828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032375 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b30f211-c488-453d-89bb-e814ebda2766" containerName="util" Jul 29 19:24:39.032828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032380 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b30f211-c488-453d-89bb-e814ebda2766" containerName="util" Jul 29 19:24:39.032828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032427 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b30f211-c488-453d-89bb-e814ebda2766" containerName="extract" Jul 29 19:24:39.032828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032435 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="35289aa7-bf76-4ec3-8a87-b60fbbc9abb8" containerName="extract" Jul 29 19:24:39.032828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032441 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d56327e-9d90-45ef-93ba-e927ccbef7b2" containerName="extract" Jul 29 19:24:39.032828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.032447 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="27dab636-bc58-4414-b441-8d96611a44d8" containerName="extract" Jul 29 19:24:39.036754 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.036727 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" Jul 29 19:24:39.038883 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.038863 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mdmlh\"" Jul 29 19:24:39.047303 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.047284 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp"] Jul 29 19:24:39.095747 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.095715 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlgrh\" (UniqueName: \"kubernetes.io/projected/6ef75170-7d55-4cd4-8e94-9a36d4f4b428-kube-api-access-rlgrh\") pod \"limitador-operator-controller-manager-859d7b78bd-cbzxp\" (UID: \"6ef75170-7d55-4cd4-8e94-9a36d4f4b428\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" Jul 29 19:24:39.196841 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.196808 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlgrh\" (UniqueName: \"kubernetes.io/projected/6ef75170-7d55-4cd4-8e94-9a36d4f4b428-kube-api-access-rlgrh\") pod \"limitador-operator-controller-manager-859d7b78bd-cbzxp\" (UID: \"6ef75170-7d55-4cd4-8e94-9a36d4f4b428\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" Jul 29 19:24:39.231357 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.231334 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlgrh\" (UniqueName: \"kubernetes.io/projected/6ef75170-7d55-4cd4-8e94-9a36d4f4b428-kube-api-access-rlgrh\") pod \"limitador-operator-controller-manager-859d7b78bd-cbzxp\" (UID: \"6ef75170-7d55-4cd4-8e94-9a36d4f4b428\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" Jul 29 19:24:39.347244 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.347162 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" Jul 29 19:24:39.473118 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.473092 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp"] Jul 29 19:24:39.474741 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:24:39.474712 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef75170_7d55_4cd4_8e94_9a36d4f4b428.slice/crio-73d6b2dc397fdc88a78af4f7a32f1682cea30adb6684ba12f66210419e23f4b3 WatchSource:0}: Error finding container 73d6b2dc397fdc88a78af4f7a32f1682cea30adb6684ba12f66210419e23f4b3: Status 404 returned error can't find the container with id 73d6b2dc397fdc88a78af4f7a32f1682cea30adb6684ba12f66210419e23f4b3 Jul 29 19:24:39.822933 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.822895 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:39.919993 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:39.919958 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" event={"ID":"6ef75170-7d55-4cd4-8e94-9a36d4f4b428","Type":"ContainerStarted","Data":"73d6b2dc397fdc88a78af4f7a32f1682cea30adb6684ba12f66210419e23f4b3"} Jul 29 19:24:40.635146 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:40.635108 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:41.930654 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:41.930616 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" event={"ID":"6ef75170-7d55-4cd4-8e94-9a36d4f4b428","Type":"ContainerStarted","Data":"6acb0086b2306c9d6c6f5f8510e74781b18581ded313dfccb0520cf183b1f00c"} Jul 29 19:24:41.931076 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:41.930765 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" Jul 29 19:24:41.950842 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:41.950799 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" podStartSLOduration=1.53007067 podStartE2EDuration="2.95078485s" totalImagesPullingTime="1.42071418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:41.949420196 +0000 UTC m=+471.837727422" watchObservedRunningTime="2026-07-29 19:24:41.95078485 +0000 UTC m=+471.839092076" Jul 29 19:24:43.828436 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:43.828400 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:43.924922 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:43.924875 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:45.764284 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:45.764249 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:45.861003 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:45.860970 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:46.679609 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:46.679576 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cksr8"] Jul 29 19:24:46.682821 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:46.682806 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cksr8" Jul 29 19:24:46.685060 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:46.685038 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bzckk\"" Jul 29 19:24:46.685168 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:46.685060 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 29 19:24:46.692279 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:46.692249 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cksr8"] Jul 29 19:24:46.861646 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:46.861613 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8bdm\" (UniqueName: \"kubernetes.io/projected/8a416e32-906e-498f-87c8-e09c583acb16-kube-api-access-w8bdm\") pod \"dns-operator-controller-manager-864dd78c4c-cksr8\" (UID: \"8a416e32-906e-498f-87c8-e09c583acb16\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cksr8" Jul 29 19:24:46.962081 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:46.962001 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8bdm\" (UniqueName: \"kubernetes.io/projected/8a416e32-906e-498f-87c8-e09c583acb16-kube-api-access-w8bdm\") pod \"dns-operator-controller-manager-864dd78c4c-cksr8\" (UID: \"8a416e32-906e-498f-87c8-e09c583acb16\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cksr8" Jul 29 19:24:46.982434 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:46.982406 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8bdm\" (UniqueName: \"kubernetes.io/projected/8a416e32-906e-498f-87c8-e09c583acb16-kube-api-access-w8bdm\") pod \"dns-operator-controller-manager-864dd78c4c-cksr8\" (UID: \"8a416e32-906e-498f-87c8-e09c583acb16\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cksr8" Jul 29 19:24:46.993364 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:46.993342 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cksr8" Jul 29 19:24:47.129412 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:47.129381 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cksr8"] Jul 29 19:24:47.132785 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:24:47.132757 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a416e32_906e_498f_87c8_e09c583acb16.slice/crio-bb87a3b29f699c62c3756b1c726fa7c37c0231038afebf2573eeb7ff884dbaa5 WatchSource:0}: Error finding container bb87a3b29f699c62c3756b1c726fa7c37c0231038afebf2573eeb7ff884dbaa5: Status 404 returned error can't find the container with id bb87a3b29f699c62c3756b1c726fa7c37c0231038afebf2573eeb7ff884dbaa5 Jul 29 19:24:47.430959 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:47.430918 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:47.966594 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:47.966559 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cksr8" event={"ID":"8a416e32-906e-498f-87c8-e09c583acb16","Type":"ContainerStarted","Data":"bb87a3b29f699c62c3756b1c726fa7c37c0231038afebf2573eeb7ff884dbaa5"} Jul 29 19:24:48.040140 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:48.040105 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:49.978038 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:49.977996 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cksr8" event={"ID":"8a416e32-906e-498f-87c8-e09c583acb16","Type":"ContainerStarted","Data":"412aff25681ec052cca0fa310539ef2f8ef4c2c2a943a2782b175b234b7eb990"} Jul 29 19:24:49.978481 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:49.978143 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cksr8" Jul 29 19:24:49.999079 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:49.999032 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cksr8" podStartSLOduration=1.5898061220000002 podStartE2EDuration="3.999019211s" totalImagesPullingTime="2.409213089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:49.997723388 +0000 UTC m=+479.886030615" watchObservedRunningTime="2026-07-29 19:24:49.999019211 +0000 UTC m=+479.887326436" Jul 29 19:24:51.542918 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:51.542883 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:52.083133 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:52.080478 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn"] Jul 29 19:24:52.084190 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:52.084166 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:24:52.087594 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:52.087571 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-j5g8m\"" Jul 29 19:24:52.115845 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:52.115814 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn"] Jul 29 19:24:52.207549 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:52.207501 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw9x5\" (UniqueName: \"kubernetes.io/projected/0183c2d5-db58-41a6-a3bc-821847905e45-kube-api-access-xw9x5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9tmn\" (UID: \"0183c2d5-db58-41a6-a3bc-821847905e45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:24:52.207656 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:52.207601 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0183c2d5-db58-41a6-a3bc-821847905e45-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9tmn\" (UID: \"0183c2d5-db58-41a6-a3bc-821847905e45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:24:52.308503 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:52.308471 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0183c2d5-db58-41a6-a3bc-821847905e45-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9tmn\" (UID: \"0183c2d5-db58-41a6-a3bc-821847905e45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:24:52.308635 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:52.308567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw9x5\" (UniqueName: \"kubernetes.io/projected/0183c2d5-db58-41a6-a3bc-821847905e45-kube-api-access-xw9x5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9tmn\" (UID: \"0183c2d5-db58-41a6-a3bc-821847905e45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:24:52.308827 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:52.308809 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0183c2d5-db58-41a6-a3bc-821847905e45-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9tmn\" (UID: \"0183c2d5-db58-41a6-a3bc-821847905e45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:24:52.325623 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:52.325602 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw9x5\" (UniqueName: \"kubernetes.io/projected/0183c2d5-db58-41a6-a3bc-821847905e45-kube-api-access-xw9x5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9tmn\" (UID: \"0183c2d5-db58-41a6-a3bc-821847905e45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:24:52.394082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:52.394059 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:24:52.529305 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:52.529169 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn"] Jul 29 19:24:52.532145 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:24:52.532118 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0183c2d5_db58_41a6_a3bc_821847905e45.slice/crio-fa47c995dad1666aedcd333e3db49eae90ce6b44b03ccc03e1e6946061710a70 WatchSource:0}: Error finding container fa47c995dad1666aedcd333e3db49eae90ce6b44b03ccc03e1e6946061710a70: Status 404 returned error can't find the container with id fa47c995dad1666aedcd333e3db49eae90ce6b44b03ccc03e1e6946061710a70 Jul 29 19:24:52.941054 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:52.941018 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" Jul 29 19:24:52.993752 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:52.993713 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" event={"ID":"0183c2d5-db58-41a6-a3bc-821847905e45","Type":"ContainerStarted","Data":"fa47c995dad1666aedcd333e3db49eae90ce6b44b03ccc03e1e6946061710a70"} Jul 29 19:24:53.460557 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:53.460503 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:53.583255 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:53.583221 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:57.025876 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:57.025788 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" event={"ID":"0183c2d5-db58-41a6-a3bc-821847905e45","Type":"ContainerStarted","Data":"ec0b2c4a66e80da89ad5a1ebcb2f0b111a449aa6000f723260da21680bdaa15b"} Jul 29 19:24:57.026225 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:57.025877 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:24:57.054348 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:57.054298 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" podStartSLOduration=0.867101582 podStartE2EDuration="5.054285995s" totalImagesPullingTime="4.187184413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:24:57.050005447 +0000 UTC m=+486.938312674" watchObservedRunningTime="2026-07-29 19:24:57.054285995 +0000 UTC m=+486.942593222" Jul 29 19:24:57.411656 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:57.411621 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:57.506165 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:57.506129 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:57.895653 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:57.895619 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:57.980037 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:57.980000 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:59.428231 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:59.428200 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:24:59.665000 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:24:59.664962 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:00.025246 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:00.025215 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:00.601224 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:00.601186 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:00.701437 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:00.701406 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:00.985779 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:00.985752 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cksr8" Jul 29 19:25:05.762073 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:05.762039 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:05.863084 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:05.863050 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:08.033203 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:08.033174 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:25:10.065389 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.065356 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn"] Jul 29 19:25:10.065864 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.065602 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" podUID="0183c2d5-db58-41a6-a3bc-821847905e45" containerName="manager" containerID="cri-o://ec0b2c4a66e80da89ad5a1ebcb2f0b111a449aa6000f723260da21680bdaa15b" gracePeriod=2 Jul 29 19:25:10.083362 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.083334 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn"] Jul 29 19:25:10.101384 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.101353 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp"] Jul 29 19:25:10.101657 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.101630 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" podUID="6ef75170-7d55-4cd4-8e94-9a36d4f4b428" containerName="manager" containerID="cri-o://6acb0086b2306c9d6c6f5f8510e74781b18581ded313dfccb0520cf183b1f00c" gracePeriod=2 Jul 29 19:25:10.117036 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.117003 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp"] Jul 29 19:25:10.120028 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:25:10.119995 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k9tmn\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="0183c2d5-db58-41a6-a3bc-821847905e45" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:25:10.122287 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:25:10.122256 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cbzxp\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="6ef75170-7d55-4cd4-8e94-9a36d4f4b428" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" Jul 29 19:25:10.132226 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.132193 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb"] Jul 29 19:25:10.132647 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.132627 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ef75170-7d55-4cd4-8e94-9a36d4f4b428" containerName="manager" Jul 29 19:25:10.132746 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.132649 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ef75170-7d55-4cd4-8e94-9a36d4f4b428" containerName="manager" Jul 29 19:25:10.132746 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.132667 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0183c2d5-db58-41a6-a3bc-821847905e45" containerName="manager" Jul 29 19:25:10.132746 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.132676 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0183c2d5-db58-41a6-a3bc-821847905e45" containerName="manager" Jul 29 19:25:10.132912 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.132753 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ef75170-7d55-4cd4-8e94-9a36d4f4b428" containerName="manager" Jul 29 19:25:10.132912 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.132768 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0183c2d5-db58-41a6-a3bc-821847905e45" containerName="manager" Jul 29 19:25:10.136087 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.136068 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" Jul 29 19:25:10.138775 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:25:10.138748 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k9tmn\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="0183c2d5-db58-41a6-a3bc-821847905e45" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:25:10.140551 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:25:10.140523 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cbzxp\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="6ef75170-7d55-4cd4-8e94-9a36d4f4b428" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" Jul 29 19:25:10.147964 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.147939 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddf3980b-9612-4fcb-b1ce-b4d98193aada-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dp8zb\" (UID: \"ddf3980b-9612-4fcb-b1ce-b4d98193aada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" Jul 29 19:25:10.148060 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.147970 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkmzx\" (UniqueName: \"kubernetes.io/projected/ddf3980b-9612-4fcb-b1ce-b4d98193aada-kube-api-access-bkmzx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dp8zb\" (UID: \"ddf3980b-9612-4fcb-b1ce-b4d98193aada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" Jul 29 19:25:10.153520 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.153489 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rkq9"] Jul 29 19:25:10.157315 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.157298 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rkq9" Jul 29 19:25:10.182173 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.182150 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb"] Jul 29 19:25:10.201407 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.201382 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rkq9"] Jul 29 19:25:10.236640 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:25:10.236499 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cbzxp\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="6ef75170-7d55-4cd4-8e94-9a36d4f4b428" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" Jul 29 19:25:10.238440 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:25:10.238406 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k9tmn\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="0183c2d5-db58-41a6-a3bc-821847905e45" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:25:10.249323 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.249290 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddf3980b-9612-4fcb-b1ce-b4d98193aada-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dp8zb\" (UID: \"ddf3980b-9612-4fcb-b1ce-b4d98193aada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" Jul 29 19:25:10.249443 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.249339 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkmzx\" (UniqueName: \"kubernetes.io/projected/ddf3980b-9612-4fcb-b1ce-b4d98193aada-kube-api-access-bkmzx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dp8zb\" (UID: \"ddf3980b-9612-4fcb-b1ce-b4d98193aada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" Jul 29 19:25:10.249443 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.249401 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv5dx\" (UniqueName: \"kubernetes.io/projected/08950801-eef4-493d-8533-d0ded0223733-kube-api-access-nv5dx\") pod \"limitador-operator-controller-manager-859d7b78bd-6rkq9\" (UID: \"08950801-eef4-493d-8533-d0ded0223733\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rkq9" Jul 29 19:25:10.249903 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.249879 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddf3980b-9612-4fcb-b1ce-b4d98193aada-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dp8zb\" (UID: \"ddf3980b-9612-4fcb-b1ce-b4d98193aada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" Jul 29 19:25:10.268759 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.268730 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkmzx\" (UniqueName: \"kubernetes.io/projected/ddf3980b-9612-4fcb-b1ce-b4d98193aada-kube-api-access-bkmzx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dp8zb\" (UID: \"ddf3980b-9612-4fcb-b1ce-b4d98193aada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" Jul 29 19:25:10.350090 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.350061 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv5dx\" (UniqueName: \"kubernetes.io/projected/08950801-eef4-493d-8533-d0ded0223733-kube-api-access-nv5dx\") pod \"limitador-operator-controller-manager-859d7b78bd-6rkq9\" (UID: \"08950801-eef4-493d-8533-d0ded0223733\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rkq9" Jul 29 19:25:10.366541 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.366502 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv5dx\" (UniqueName: \"kubernetes.io/projected/08950801-eef4-493d-8533-d0ded0223733-kube-api-access-nv5dx\") pod \"limitador-operator-controller-manager-859d7b78bd-6rkq9\" (UID: \"08950801-eef4-493d-8533-d0ded0223733\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rkq9" Jul 29 19:25:10.366667 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.366651 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:25:10.368895 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.368877 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" Jul 29 19:25:10.371382 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:25:10.371361 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cbzxp\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="6ef75170-7d55-4cd4-8e94-9a36d4f4b428" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" Jul 29 19:25:10.374490 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:25:10.374469 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k9tmn\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="0183c2d5-db58-41a6-a3bc-821847905e45" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:25:10.377271 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:25:10.377253 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cbzxp\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="6ef75170-7d55-4cd4-8e94-9a36d4f4b428" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" Jul 29 19:25:10.378711 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:25:10.378677 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k9tmn\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="0183c2d5-db58-41a6-a3bc-821847905e45" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:25:10.450729 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.450701 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xw9x5\" (UniqueName: \"kubernetes.io/projected/0183c2d5-db58-41a6-a3bc-821847905e45-kube-api-access-xw9x5\") pod \"0183c2d5-db58-41a6-a3bc-821847905e45\" (UID: \"0183c2d5-db58-41a6-a3bc-821847905e45\") " Jul 29 19:25:10.451180 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.450764 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlgrh\" (UniqueName: \"kubernetes.io/projected/6ef75170-7d55-4cd4-8e94-9a36d4f4b428-kube-api-access-rlgrh\") pod \"6ef75170-7d55-4cd4-8e94-9a36d4f4b428\" (UID: \"6ef75170-7d55-4cd4-8e94-9a36d4f4b428\") " Jul 29 19:25:10.451180 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.450797 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0183c2d5-db58-41a6-a3bc-821847905e45-extensions-socket-volume\") pod \"0183c2d5-db58-41a6-a3bc-821847905e45\" (UID: \"0183c2d5-db58-41a6-a3bc-821847905e45\") " Jul 29 19:25:10.451384 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.451260 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0183c2d5-db58-41a6-a3bc-821847905e45-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0183c2d5-db58-41a6-a3bc-821847905e45" (UID: "0183c2d5-db58-41a6-a3bc-821847905e45"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:25:10.452672 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.452652 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0183c2d5-db58-41a6-a3bc-821847905e45-kube-api-access-xw9x5" (OuterVolumeSpecName: "kube-api-access-xw9x5") pod "0183c2d5-db58-41a6-a3bc-821847905e45" (UID: "0183c2d5-db58-41a6-a3bc-821847905e45"). InnerVolumeSpecName "kube-api-access-xw9x5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:25:10.452770 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.452750 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ef75170-7d55-4cd4-8e94-9a36d4f4b428-kube-api-access-rlgrh" (OuterVolumeSpecName: "kube-api-access-rlgrh") pod "6ef75170-7d55-4cd4-8e94-9a36d4f4b428" (UID: "6ef75170-7d55-4cd4-8e94-9a36d4f4b428"). InnerVolumeSpecName "kube-api-access-rlgrh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:25:10.509626 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.509601 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" Jul 29 19:25:10.516592 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.516572 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rkq9" Jul 29 19:25:10.552242 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.552204 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0183c2d5-db58-41a6-a3bc-821847905e45-extensions-socket-volume\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:25:10.552242 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.552244 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw9x5\" (UniqueName: \"kubernetes.io/projected/0183c2d5-db58-41a6-a3bc-821847905e45-kube-api-access-xw9x5\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:25:10.552423 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.552261 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlgrh\" (UniqueName: \"kubernetes.io/projected/6ef75170-7d55-4cd4-8e94-9a36d4f4b428-kube-api-access-rlgrh\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:25:10.664095 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.664039 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb"] Jul 29 19:25:10.666463 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:25:10.666440 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddf3980b_9612_4fcb_b1ce_b4d98193aada.slice/crio-a8015e6b241eecbb7136b6992f6851dfd1263d161260b6473651631122845bc7 WatchSource:0}: Error finding container a8015e6b241eecbb7136b6992f6851dfd1263d161260b6473651631122845bc7: Status 404 returned error can't find the container with id a8015e6b241eecbb7136b6992f6851dfd1263d161260b6473651631122845bc7 Jul 29 19:25:10.705161 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.705138 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rkq9"] Jul 29 19:25:10.707534 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:25:10.707495 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08950801_eef4_493d_8533_d0ded0223733.slice/crio-77087cb25d8102153af09d8d30787f6a28ec74b0c4791f4325ba377a9155c5f8 WatchSource:0}: Error finding container 77087cb25d8102153af09d8d30787f6a28ec74b0c4791f4325ba377a9155c5f8: Status 404 returned error can't find the container with id 77087cb25d8102153af09d8d30787f6a28ec74b0c4791f4325ba377a9155c5f8 Jul 29 19:25:10.736900 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:25:10.736246 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k9tmn\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="0183c2d5-db58-41a6-a3bc-821847905e45" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:25:10.737691 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.737664 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0183c2d5-db58-41a6-a3bc-821847905e45" path="/var/lib/kubelet/pods/0183c2d5-db58-41a6-a3bc-821847905e45/volumes" Jul 29 19:25:10.738134 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:10.738116 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ef75170-7d55-4cd4-8e94-9a36d4f4b428" path="/var/lib/kubelet/pods/6ef75170-7d55-4cd4-8e94-9a36d4f4b428/volumes" Jul 29 19:25:10.740009 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:25:10.739984 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cbzxp\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="6ef75170-7d55-4cd4-8e94-9a36d4f4b428" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" Jul 29 19:25:11.098839 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.098812 2574 generic.go:356] "Generic (PLEG): container finished" podID="0183c2d5-db58-41a6-a3bc-821847905e45" containerID="ec0b2c4a66e80da89ad5a1ebcb2f0b111a449aa6000f723260da21680bdaa15b" exitCode=0 Jul 29 19:25:11.099277 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.098854 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9tmn" Jul 29 19:25:11.099277 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.098917 2574 scope.go:117] "RemoveContainer" containerID="ec0b2c4a66e80da89ad5a1ebcb2f0b111a449aa6000f723260da21680bdaa15b" Jul 29 19:25:11.100232 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.100213 2574 generic.go:356] "Generic (PLEG): container finished" podID="6ef75170-7d55-4cd4-8e94-9a36d4f4b428" containerID="6acb0086b2306c9d6c6f5f8510e74781b18581ded313dfccb0520cf183b1f00c" exitCode=0 Jul 29 19:25:11.100298 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.100246 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cbzxp" Jul 29 19:25:11.102310 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.102138 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rkq9" event={"ID":"08950801-eef4-493d-8533-d0ded0223733","Type":"ContainerStarted","Data":"e78263db4fd309ddd74184e1fb236ac367770f131e83b6fb6ff7055943f6e320"} Jul 29 19:25:11.102310 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.102212 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rkq9" Jul 29 19:25:11.102310 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.102247 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rkq9" event={"ID":"08950801-eef4-493d-8533-d0ded0223733","Type":"ContainerStarted","Data":"77087cb25d8102153af09d8d30787f6a28ec74b0c4791f4325ba377a9155c5f8"} Jul 29 19:25:11.103897 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.103876 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" event={"ID":"ddf3980b-9612-4fcb-b1ce-b4d98193aada","Type":"ContainerStarted","Data":"c71a1f95b83c95daa411047fbed9ed373430fe37edd9daa3d5dd6cf7d0b545a1"} Jul 29 19:25:11.103983 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.103919 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" event={"ID":"ddf3980b-9612-4fcb-b1ce-b4d98193aada","Type":"ContainerStarted","Data":"a8015e6b241eecbb7136b6992f6851dfd1263d161260b6473651631122845bc7"} Jul 29 19:25:11.103983 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.103954 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" Jul 29 19:25:11.108386 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.108365 2574 scope.go:117] "RemoveContainer" containerID="ec0b2c4a66e80da89ad5a1ebcb2f0b111a449aa6000f723260da21680bdaa15b" Jul 29 19:25:11.108630 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:25:11.108615 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec0b2c4a66e80da89ad5a1ebcb2f0b111a449aa6000f723260da21680bdaa15b\": container with ID starting with ec0b2c4a66e80da89ad5a1ebcb2f0b111a449aa6000f723260da21680bdaa15b not found: ID does not exist" containerID="ec0b2c4a66e80da89ad5a1ebcb2f0b111a449aa6000f723260da21680bdaa15b" Jul 29 19:25:11.108682 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.108637 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0b2c4a66e80da89ad5a1ebcb2f0b111a449aa6000f723260da21680bdaa15b"} err="failed to get container status \"ec0b2c4a66e80da89ad5a1ebcb2f0b111a449aa6000f723260da21680bdaa15b\": rpc error: code = NotFound desc = could not find container \"ec0b2c4a66e80da89ad5a1ebcb2f0b111a449aa6000f723260da21680bdaa15b\": container with ID starting with ec0b2c4a66e80da89ad5a1ebcb2f0b111a449aa6000f723260da21680bdaa15b not found: ID does not exist" Jul 29 19:25:11.108682 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.108651 2574 scope.go:117] "RemoveContainer" containerID="6acb0086b2306c9d6c6f5f8510e74781b18581ded313dfccb0520cf183b1f00c" Jul 29 19:25:11.116076 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.116057 2574 scope.go:117] "RemoveContainer" containerID="6acb0086b2306c9d6c6f5f8510e74781b18581ded313dfccb0520cf183b1f00c" Jul 29 19:25:11.116297 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:25:11.116279 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6acb0086b2306c9d6c6f5f8510e74781b18581ded313dfccb0520cf183b1f00c\": container with ID starting with 6acb0086b2306c9d6c6f5f8510e74781b18581ded313dfccb0520cf183b1f00c not found: ID does not exist" containerID="6acb0086b2306c9d6c6f5f8510e74781b18581ded313dfccb0520cf183b1f00c" Jul 29 19:25:11.116342 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.116302 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6acb0086b2306c9d6c6f5f8510e74781b18581ded313dfccb0520cf183b1f00c"} err="failed to get container status \"6acb0086b2306c9d6c6f5f8510e74781b18581ded313dfccb0520cf183b1f00c\": rpc error: code = NotFound desc = could not find container \"6acb0086b2306c9d6c6f5f8510e74781b18581ded313dfccb0520cf183b1f00c\": container with ID starting with 6acb0086b2306c9d6c6f5f8510e74781b18581ded313dfccb0520cf183b1f00c not found: ID does not exist" Jul 29 19:25:11.134549 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.134498 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rkq9" podStartSLOduration=1.134486338 podStartE2EDuration="1.134486338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:25:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:25:11.1317498 +0000 UTC m=+501.020057027" watchObservedRunningTime="2026-07-29 19:25:11.134486338 +0000 UTC m=+501.022793564" Jul 29 19:25:11.162191 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:11.162127 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" podStartSLOduration=1.162115496 podStartE2EDuration="1.162115496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:25:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:25:11.15991136 +0000 UTC m=+501.048218586" watchObservedRunningTime="2026-07-29 19:25:11.162115496 +0000 UTC m=+501.050422763" Jul 29 19:25:12.540842 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:12.540807 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:12.646287 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:12.646248 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:17.892221 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:17.892179 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:17.948208 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:17.948179 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:18.614152 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:18.614104 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:18.709432 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:18.709387 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:22.113364 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:22.113332 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" Jul 29 19:25:22.113977 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:22.113603 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rkq9" Jul 29 19:25:22.292794 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:22.292755 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:22.396789 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:22.396753 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:25.976797 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:25.976756 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:26.123449 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:26.123411 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:33.270796 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:33.270759 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:33.371482 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:33.371449 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:39.536541 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:39.536493 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb"] Jul 29 19:25:39.537018 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:39.536738 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" podUID="ddf3980b-9612-4fcb-b1ce-b4d98193aada" containerName="manager" containerID="cri-o://c71a1f95b83c95daa411047fbed9ed373430fe37edd9daa3d5dd6cf7d0b545a1" gracePeriod=10 Jul 29 19:25:39.781430 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:39.781396 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" Jul 29 19:25:39.904025 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:39.903996 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkmzx\" (UniqueName: \"kubernetes.io/projected/ddf3980b-9612-4fcb-b1ce-b4d98193aada-kube-api-access-bkmzx\") pod \"ddf3980b-9612-4fcb-b1ce-b4d98193aada\" (UID: \"ddf3980b-9612-4fcb-b1ce-b4d98193aada\") " Jul 29 19:25:39.904227 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:39.904070 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddf3980b-9612-4fcb-b1ce-b4d98193aada-extensions-socket-volume\") pod \"ddf3980b-9612-4fcb-b1ce-b4d98193aada\" (UID: \"ddf3980b-9612-4fcb-b1ce-b4d98193aada\") " Jul 29 19:25:39.904435 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:39.904413 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddf3980b-9612-4fcb-b1ce-b4d98193aada-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ddf3980b-9612-4fcb-b1ce-b4d98193aada" (UID: "ddf3980b-9612-4fcb-b1ce-b4d98193aada"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:25:39.906075 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:39.906046 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddf3980b-9612-4fcb-b1ce-b4d98193aada-kube-api-access-bkmzx" (OuterVolumeSpecName: "kube-api-access-bkmzx") pod "ddf3980b-9612-4fcb-b1ce-b4d98193aada" (UID: "ddf3980b-9612-4fcb-b1ce-b4d98193aada"). InnerVolumeSpecName "kube-api-access-bkmzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:25:40.005653 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:40.005618 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkmzx\" (UniqueName: \"kubernetes.io/projected/ddf3980b-9612-4fcb-b1ce-b4d98193aada-kube-api-access-bkmzx\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:25:40.005653 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:40.005645 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddf3980b-9612-4fcb-b1ce-b4d98193aada-extensions-socket-volume\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:25:40.259577 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:40.259484 2574 generic.go:356] "Generic (PLEG): container finished" podID="ddf3980b-9612-4fcb-b1ce-b4d98193aada" containerID="c71a1f95b83c95daa411047fbed9ed373430fe37edd9daa3d5dd6cf7d0b545a1" exitCode=0 Jul 29 19:25:40.259577 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:40.259553 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" Jul 29 19:25:40.259779 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:40.259572 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" event={"ID":"ddf3980b-9612-4fcb-b1ce-b4d98193aada","Type":"ContainerDied","Data":"c71a1f95b83c95daa411047fbed9ed373430fe37edd9daa3d5dd6cf7d0b545a1"} Jul 29 19:25:40.259779 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:40.259626 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb" event={"ID":"ddf3980b-9612-4fcb-b1ce-b4d98193aada","Type":"ContainerDied","Data":"a8015e6b241eecbb7136b6992f6851dfd1263d161260b6473651631122845bc7"} Jul 29 19:25:40.259779 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:40.259649 2574 scope.go:117] "RemoveContainer" containerID="c71a1f95b83c95daa411047fbed9ed373430fe37edd9daa3d5dd6cf7d0b545a1" Jul 29 19:25:40.268753 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:40.268734 2574 scope.go:117] "RemoveContainer" containerID="c71a1f95b83c95daa411047fbed9ed373430fe37edd9daa3d5dd6cf7d0b545a1" Jul 29 19:25:40.269015 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:25:40.268996 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c71a1f95b83c95daa411047fbed9ed373430fe37edd9daa3d5dd6cf7d0b545a1\": container with ID starting with c71a1f95b83c95daa411047fbed9ed373430fe37edd9daa3d5dd6cf7d0b545a1 not found: ID does not exist" containerID="c71a1f95b83c95daa411047fbed9ed373430fe37edd9daa3d5dd6cf7d0b545a1" Jul 29 19:25:40.269086 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:40.269023 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c71a1f95b83c95daa411047fbed9ed373430fe37edd9daa3d5dd6cf7d0b545a1"} err="failed to get container status \"c71a1f95b83c95daa411047fbed9ed373430fe37edd9daa3d5dd6cf7d0b545a1\": rpc error: code = NotFound desc = could not find container \"c71a1f95b83c95daa411047fbed9ed373430fe37edd9daa3d5dd6cf7d0b545a1\": container with ID starting with c71a1f95b83c95daa411047fbed9ed373430fe37edd9daa3d5dd6cf7d0b545a1 not found: ID does not exist" Jul 29 19:25:40.284029 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:40.284004 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb"] Jul 29 19:25:40.288081 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:40.288060 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dp8zb"] Jul 29 19:25:40.736027 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:40.735984 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddf3980b-9612-4fcb-b1ce-b4d98193aada" path="/var/lib/kubelet/pods/ddf3980b-9612-4fcb-b1ce-b4d98193aada/volumes" Jul 29 19:25:49.043135 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:49.043047 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:49.095216 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:49.095185 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:55.876144 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:55.876111 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng"] Jul 29 19:25:55.876595 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:55.876449 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddf3980b-9612-4fcb-b1ce-b4d98193aada" containerName="manager" Jul 29 19:25:55.876595 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:55.876459 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf3980b-9612-4fcb-b1ce-b4d98193aada" containerName="manager" Jul 29 19:25:55.876595 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:55.876529 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddf3980b-9612-4fcb-b1ce-b4d98193aada" containerName="manager" Jul 29 19:25:55.880828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:55.880812 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:55.882915 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:55.882895 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lm5pp\"" Jul 29 19:25:55.890503 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:55.890478 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng"] Jul 29 19:25:55.895134 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:55.895107 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:56.040755 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.040718 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25fa8c35-be85-4183-9249-b06576f2ed0e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.040755 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.040766 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25fa8c35-be85-4183-9249-b06576f2ed0e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.040755 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.040796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25fa8c35-be85-4183-9249-b06576f2ed0e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.041138 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.040852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25fa8c35-be85-4183-9249-b06576f2ed0e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.041138 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.040902 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25fa8c35-be85-4183-9249-b06576f2ed0e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.041138 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.040967 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25fa8c35-be85-4183-9249-b06576f2ed0e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.041138 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.041004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwl6m\" (UniqueName: \"kubernetes.io/projected/25fa8c35-be85-4183-9249-b06576f2ed0e-kube-api-access-hwl6m\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.041138 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.041084 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25fa8c35-be85-4183-9249-b06576f2ed0e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.041138 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.041123 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25fa8c35-be85-4183-9249-b06576f2ed0e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.084213 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.084179 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:56.141862 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.141830 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25fa8c35-be85-4183-9249-b06576f2ed0e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.142032 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.141887 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwl6m\" (UniqueName: \"kubernetes.io/projected/25fa8c35-be85-4183-9249-b06576f2ed0e-kube-api-access-hwl6m\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.142032 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.141933 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25fa8c35-be85-4183-9249-b06576f2ed0e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.142032 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.141982 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25fa8c35-be85-4183-9249-b06576f2ed0e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.142032 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.142019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25fa8c35-be85-4183-9249-b06576f2ed0e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.142220 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.142043 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25fa8c35-be85-4183-9249-b06576f2ed0e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.142220 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.142151 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25fa8c35-be85-4183-9249-b06576f2ed0e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.142220 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.142203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25fa8c35-be85-4183-9249-b06576f2ed0e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.142391 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.142241 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25fa8c35-be85-4183-9249-b06576f2ed0e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.142454 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.142383 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25fa8c35-be85-4183-9249-b06576f2ed0e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.142454 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.142415 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25fa8c35-be85-4183-9249-b06576f2ed0e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.142603 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.142542 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25fa8c35-be85-4183-9249-b06576f2ed0e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.142801 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.142782 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25fa8c35-be85-4183-9249-b06576f2ed0e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.142883 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.142867 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25fa8c35-be85-4183-9249-b06576f2ed0e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.144257 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.144241 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25fa8c35-be85-4183-9249-b06576f2ed0e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.144521 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.144496 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25fa8c35-be85-4183-9249-b06576f2ed0e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.150701 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.150679 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25fa8c35-be85-4183-9249-b06576f2ed0e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.150785 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.150688 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwl6m\" (UniqueName: \"kubernetes.io/projected/25fa8c35-be85-4183-9249-b06576f2ed0e-kube-api-access-hwl6m\") pod \"maas-default-gateway-openshift-default-78bb78ff78-p4wng\" (UID: \"25fa8c35-be85-4183-9249-b06576f2ed0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.192676 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.192644 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:56.325453 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.325428 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng"] Jul 29 19:25:56.327405 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:25:56.327375 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25fa8c35_be85_4183_9249_b06576f2ed0e.slice/crio-e55f05292d19249ce2108b4ed8c674869012a608969fe02b6a32e9f36e3efddd WatchSource:0}: Error finding container e55f05292d19249ce2108b4ed8c674869012a608969fe02b6a32e9f36e3efddd: Status 404 returned error can't find the container with id e55f05292d19249ce2108b4ed8c674869012a608969fe02b6a32e9f36e3efddd Jul 29 19:25:56.329399 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.329365 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:25:56.329554 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.329477 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:25:56.329554 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.329523 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:25:56.340795 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:56.340756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" event={"ID":"25fa8c35-be85-4183-9249-b06576f2ed0e","Type":"ContainerStarted","Data":"e55f05292d19249ce2108b4ed8c674869012a608969fe02b6a32e9f36e3efddd"} Jul 29 19:25:57.347710 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:57.347675 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" event={"ID":"25fa8c35-be85-4183-9249-b06576f2ed0e","Type":"ContainerStarted","Data":"55391d7ceb5a9ff86bd5520bd16cdca8d2288453c89697fca72cb6c369affb1b"} Jul 29 19:25:57.366860 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:57.366811 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" podStartSLOduration=2.366796475 podStartE2EDuration="2.366796475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:25:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:25:57.365979272 +0000 UTC m=+547.254286500" watchObservedRunningTime="2026-07-29 19:25:57.366796475 +0000 UTC m=+547.255103701" Jul 29 19:25:58.193039 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.193003 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:58.197759 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.197735 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:58.353140 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.353110 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:58.354212 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.354190 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:25:58.496903 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.496822 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lw9kj"] Jul 29 19:25:58.504577 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.504542 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:58.506931 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.506902 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" Jul 29 19:25:58.508903 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.508878 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lw9kj"] Jul 29 19:25:58.509020 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.508909 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 29 19:25:58.509020 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.508931 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-shqcg\"" Jul 29 19:25:58.593038 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.593007 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lw9kj"] Jul 29 19:25:58.596020 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.595987 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:58.645218 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.645185 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:58.663382 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.663355 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cbe5b378-1d44-4d7e-84bd-2242b4aab589-config-file\") pod \"limitador-limitador-64c94fd64f-lw9kj\" (UID: \"cbe5b378-1d44-4d7e-84bd-2242b4aab589\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" Jul 29 19:25:58.663498 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.663390 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjg4c\" (UniqueName: \"kubernetes.io/projected/cbe5b378-1d44-4d7e-84bd-2242b4aab589-kube-api-access-pjg4c\") pod \"limitador-limitador-64c94fd64f-lw9kj\" (UID: \"cbe5b378-1d44-4d7e-84bd-2242b4aab589\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" Jul 29 19:25:58.764580 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.764469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cbe5b378-1d44-4d7e-84bd-2242b4aab589-config-file\") pod \"limitador-limitador-64c94fd64f-lw9kj\" (UID: \"cbe5b378-1d44-4d7e-84bd-2242b4aab589\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" Jul 29 19:25:58.764580 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.764501 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjg4c\" (UniqueName: \"kubernetes.io/projected/cbe5b378-1d44-4d7e-84bd-2242b4aab589-kube-api-access-pjg4c\") pod \"limitador-limitador-64c94fd64f-lw9kj\" (UID: \"cbe5b378-1d44-4d7e-84bd-2242b4aab589\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" Jul 29 19:25:58.765059 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.765042 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cbe5b378-1d44-4d7e-84bd-2242b4aab589-config-file\") pod \"limitador-limitador-64c94fd64f-lw9kj\" (UID: \"cbe5b378-1d44-4d7e-84bd-2242b4aab589\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" Jul 29 19:25:58.772201 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.772180 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjg4c\" (UniqueName: \"kubernetes.io/projected/cbe5b378-1d44-4d7e-84bd-2242b4aab589-kube-api-access-pjg4c\") pod \"limitador-limitador-64c94fd64f-lw9kj\" (UID: \"cbe5b378-1d44-4d7e-84bd-2242b4aab589\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" Jul 29 19:25:58.820194 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.820169 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" Jul 29 19:25:58.952279 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:58.952251 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lw9kj"] Jul 29 19:25:58.953819 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:25:58.953791 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbe5b378_1d44_4d7e_84bd_2242b4aab589.slice/crio-2b6a0c01473d0f2cc710b3f452de6fe3a600a1c24ead18af09febaca8ba3fc32 WatchSource:0}: Error finding container 2b6a0c01473d0f2cc710b3f452de6fe3a600a1c24ead18af09febaca8ba3fc32: Status 404 returned error can't find the container with id 2b6a0c01473d0f2cc710b3f452de6fe3a600a1c24ead18af09febaca8ba3fc32 Jul 29 19:25:59.289875 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.289840 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-dk2xw"] Jul 29 19:25:59.294434 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.294415 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dk2xw" Jul 29 19:25:59.296851 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.296827 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nvsfb\"" Jul 29 19:25:59.299331 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.299305 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-dk2xw"] Jul 29 19:25:59.328693 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.328665 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:59.359320 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.359293 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" event={"ID":"cbe5b378-1d44-4d7e-84bd-2242b4aab589","Type":"ContainerStarted","Data":"2b6a0c01473d0f2cc710b3f452de6fe3a600a1c24ead18af09febaca8ba3fc32"} Jul 29 19:25:59.400547 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.400503 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:25:59.471134 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.471107 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdgg2\" (UniqueName: \"kubernetes.io/projected/22651348-7da2-4173-ab14-acf7dfde8a3f-kube-api-access-cdgg2\") pod \"authorino-58cd955675-dk2xw\" (UID: \"22651348-7da2-4173-ab14-acf7dfde8a3f\") " pod="kuadrant-system/authorino-58cd955675-dk2xw" Jul 29 19:25:59.572731 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.572268 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdgg2\" (UniqueName: \"kubernetes.io/projected/22651348-7da2-4173-ab14-acf7dfde8a3f-kube-api-access-cdgg2\") pod \"authorino-58cd955675-dk2xw\" (UID: \"22651348-7da2-4173-ab14-acf7dfde8a3f\") " pod="kuadrant-system/authorino-58cd955675-dk2xw" Jul 29 19:25:59.587952 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.587919 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdgg2\" (UniqueName: \"kubernetes.io/projected/22651348-7da2-4173-ab14-acf7dfde8a3f-kube-api-access-cdgg2\") pod \"authorino-58cd955675-dk2xw\" (UID: \"22651348-7da2-4173-ab14-acf7dfde8a3f\") " pod="kuadrant-system/authorino-58cd955675-dk2xw" Jul 29 19:25:59.605080 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.605047 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-xkq2l"] Jul 29 19:25:59.607006 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.606863 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dk2xw" Jul 29 19:25:59.609545 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.609316 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xkq2l" Jul 29 19:25:59.625484 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.625442 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xkq2l"] Jul 29 19:25:59.673430 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.673262 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmtsb\" (UniqueName: \"kubernetes.io/projected/8413ce67-2613-4ea0-9391-4cf90643ca0d-kube-api-access-gmtsb\") pod \"authorino-75d556bd77-xkq2l\" (UID: \"8413ce67-2613-4ea0-9391-4cf90643ca0d\") " pod="kuadrant-system/authorino-75d556bd77-xkq2l" Jul 29 19:25:59.774580 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.774546 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmtsb\" (UniqueName: \"kubernetes.io/projected/8413ce67-2613-4ea0-9391-4cf90643ca0d-kube-api-access-gmtsb\") pod \"authorino-75d556bd77-xkq2l\" (UID: \"8413ce67-2613-4ea0-9391-4cf90643ca0d\") " pod="kuadrant-system/authorino-75d556bd77-xkq2l" Jul 29 19:25:59.786709 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:25:59.786661 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22651348_7da2_4173_ab14_acf7dfde8a3f.slice/crio-74bb69a7b92426a6792774bd062d21d1777de94d538ff4f0a1e81f6a81599ab0 WatchSource:0}: Error finding container 74bb69a7b92426a6792774bd062d21d1777de94d538ff4f0a1e81f6a81599ab0: Status 404 returned error can't find the container with id 74bb69a7b92426a6792774bd062d21d1777de94d538ff4f0a1e81f6a81599ab0 Jul 29 19:25:59.786824 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.786722 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-dk2xw"] Jul 29 19:25:59.790279 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.790257 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmtsb\" (UniqueName: \"kubernetes.io/projected/8413ce67-2613-4ea0-9391-4cf90643ca0d-kube-api-access-gmtsb\") pod \"authorino-75d556bd77-xkq2l\" (UID: \"8413ce67-2613-4ea0-9391-4cf90643ca0d\") " pod="kuadrant-system/authorino-75d556bd77-xkq2l" Jul 29 19:25:59.923521 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:25:59.923473 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xkq2l" Jul 29 19:26:00.071068 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:00.071045 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xkq2l"] Jul 29 19:26:00.073328 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:26:00.073293 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8413ce67_2613_4ea0_9391_4cf90643ca0d.slice/crio-e2c52a9dafe5cf6f457c89779e63f0c603c79e0bbd0e3f8ee1b5c9caceb82439 WatchSource:0}: Error finding container e2c52a9dafe5cf6f457c89779e63f0c603c79e0bbd0e3f8ee1b5c9caceb82439: Status 404 returned error can't find the container with id e2c52a9dafe5cf6f457c89779e63f0c603c79e0bbd0e3f8ee1b5c9caceb82439 Jul 29 19:26:00.368358 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:00.368277 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dk2xw" event={"ID":"22651348-7da2-4173-ab14-acf7dfde8a3f","Type":"ContainerStarted","Data":"74bb69a7b92426a6792774bd062d21d1777de94d538ff4f0a1e81f6a81599ab0"} Jul 29 19:26:00.370099 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:00.370064 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xkq2l" event={"ID":"8413ce67-2613-4ea0-9391-4cf90643ca0d","Type":"ContainerStarted","Data":"e2c52a9dafe5cf6f457c89779e63f0c603c79e0bbd0e3f8ee1b5c9caceb82439"} Jul 29 19:26:02.390954 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:02.390902 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" event={"ID":"cbe5b378-1d44-4d7e-84bd-2242b4aab589","Type":"ContainerStarted","Data":"1deba49ea8efc4a3b6288be2054dd6dc1c0dbd3d0aa7e543bb294804f5f3031d"} Jul 29 19:26:02.391620 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:02.391565 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" Jul 29 19:26:02.409812 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:02.409758 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" podStartSLOduration=1.628437628 podStartE2EDuration="4.409738095s" totalImagesPullingTime="2.781300467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:25:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:26:02.407360584 +0000 UTC m=+552.295667812" watchObservedRunningTime="2026-07-29 19:26:02.409738095 +0000 UTC m=+552.298045328" Jul 29 19:26:04.404792 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:04.404760 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dk2xw" event={"ID":"22651348-7da2-4173-ab14-acf7dfde8a3f","Type":"ContainerStarted","Data":"666441ec3013e710e06fb8b53b5dc579326e39851365959edc227a2fcc303d18"} Jul 29 19:26:04.406345 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:04.406319 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xkq2l" event={"ID":"8413ce67-2613-4ea0-9391-4cf90643ca0d","Type":"ContainerStarted","Data":"cb31914950e1642d5e238ecafc8211ec968487eaa9bb5bf98a5027db965483d1"} Jul 29 19:26:04.421506 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:04.421442 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-dk2xw" podStartSLOduration=1.125104972 podStartE2EDuration="5.4214286s" totalImagesPullingTime="4.296323628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:26:04.419118935 +0000 UTC m=+554.307426172" watchObservedRunningTime="2026-07-29 19:26:04.4214286 +0000 UTC m=+554.309735825" Jul 29 19:26:04.432306 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:04.432255 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-xkq2l" podStartSLOduration=1.433511389 podStartE2EDuration="5.432238872s" totalImagesPullingTime="3.998727483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:26:04.432107881 +0000 UTC m=+554.320415122" watchObservedRunningTime="2026-07-29 19:26:04.432238872 +0000 UTC m=+554.320546100" Jul 29 19:26:04.460174 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:04.460143 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-dk2xw"] Jul 29 19:26:06.416226 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:06.416184 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-dk2xw" podUID="22651348-7da2-4173-ab14-acf7dfde8a3f" containerName="authorino" containerID="cri-o://666441ec3013e710e06fb8b53b5dc579326e39851365959edc227a2fcc303d18" gracePeriod=30 Jul 29 19:26:06.661356 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:06.661330 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dk2xw" Jul 29 19:26:06.735230 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:06.735160 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdgg2\" (UniqueName: \"kubernetes.io/projected/22651348-7da2-4173-ab14-acf7dfde8a3f-kube-api-access-cdgg2\") pod \"22651348-7da2-4173-ab14-acf7dfde8a3f\" (UID: \"22651348-7da2-4173-ab14-acf7dfde8a3f\") " Jul 29 19:26:06.737047 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:06.737025 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22651348-7da2-4173-ab14-acf7dfde8a3f-kube-api-access-cdgg2" (OuterVolumeSpecName: "kube-api-access-cdgg2") pod "22651348-7da2-4173-ab14-acf7dfde8a3f" (UID: "22651348-7da2-4173-ab14-acf7dfde8a3f"). InnerVolumeSpecName "kube-api-access-cdgg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:26:06.836258 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:06.836223 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdgg2\" (UniqueName: \"kubernetes.io/projected/22651348-7da2-4173-ab14-acf7dfde8a3f-kube-api-access-cdgg2\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:26:07.421804 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:07.421766 2574 generic.go:356] "Generic (PLEG): container finished" podID="22651348-7da2-4173-ab14-acf7dfde8a3f" containerID="666441ec3013e710e06fb8b53b5dc579326e39851365959edc227a2fcc303d18" exitCode=0 Jul 29 19:26:07.422220 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:07.421822 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dk2xw" Jul 29 19:26:07.422220 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:07.421861 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dk2xw" event={"ID":"22651348-7da2-4173-ab14-acf7dfde8a3f","Type":"ContainerDied","Data":"666441ec3013e710e06fb8b53b5dc579326e39851365959edc227a2fcc303d18"} Jul 29 19:26:07.422220 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:07.421906 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dk2xw" event={"ID":"22651348-7da2-4173-ab14-acf7dfde8a3f","Type":"ContainerDied","Data":"74bb69a7b92426a6792774bd062d21d1777de94d538ff4f0a1e81f6a81599ab0"} Jul 29 19:26:07.422220 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:07.421925 2574 scope.go:117] "RemoveContainer" containerID="666441ec3013e710e06fb8b53b5dc579326e39851365959edc227a2fcc303d18" Jul 29 19:26:07.431299 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:07.431282 2574 scope.go:117] "RemoveContainer" containerID="666441ec3013e710e06fb8b53b5dc579326e39851365959edc227a2fcc303d18" Jul 29 19:26:07.431545 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:26:07.431527 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"666441ec3013e710e06fb8b53b5dc579326e39851365959edc227a2fcc303d18\": container with ID starting with 666441ec3013e710e06fb8b53b5dc579326e39851365959edc227a2fcc303d18 not found: ID does not exist" containerID="666441ec3013e710e06fb8b53b5dc579326e39851365959edc227a2fcc303d18" Jul 29 19:26:07.431595 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:07.431553 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"666441ec3013e710e06fb8b53b5dc579326e39851365959edc227a2fcc303d18"} err="failed to get container status \"666441ec3013e710e06fb8b53b5dc579326e39851365959edc227a2fcc303d18\": rpc error: code = NotFound desc = could not find container \"666441ec3013e710e06fb8b53b5dc579326e39851365959edc227a2fcc303d18\": container with ID starting with 666441ec3013e710e06fb8b53b5dc579326e39851365959edc227a2fcc303d18 not found: ID does not exist" Jul 29 19:26:07.442594 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:07.442572 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-dk2xw"] Jul 29 19:26:07.446481 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:07.446461 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-dk2xw"] Jul 29 19:26:08.733404 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:08.733370 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22651348-7da2-4173-ab14-acf7dfde8a3f" path="/var/lib/kubelet/pods/22651348-7da2-4173-ab14-acf7dfde8a3f/volumes" Jul 29 19:26:13.399458 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:13.399422 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" Jul 29 19:26:13.520936 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:13.520897 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lw9kj"] Jul 29 19:26:13.521188 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:13.521161 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" podUID="cbe5b378-1d44-4d7e-84bd-2242b4aab589" containerName="limitador" containerID="cri-o://1deba49ea8efc4a3b6288be2054dd6dc1c0dbd3d0aa7e543bb294804f5f3031d" gracePeriod=30 Jul 29 19:26:14.076960 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.076933 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" Jul 29 19:26:14.193760 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.193722 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjg4c\" (UniqueName: \"kubernetes.io/projected/cbe5b378-1d44-4d7e-84bd-2242b4aab589-kube-api-access-pjg4c\") pod \"cbe5b378-1d44-4d7e-84bd-2242b4aab589\" (UID: \"cbe5b378-1d44-4d7e-84bd-2242b4aab589\") " Jul 29 19:26:14.193939 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.193812 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cbe5b378-1d44-4d7e-84bd-2242b4aab589-config-file\") pod \"cbe5b378-1d44-4d7e-84bd-2242b4aab589\" (UID: \"cbe5b378-1d44-4d7e-84bd-2242b4aab589\") " Jul 29 19:26:14.194195 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.194169 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbe5b378-1d44-4d7e-84bd-2242b4aab589-config-file" (OuterVolumeSpecName: "config-file") pod "cbe5b378-1d44-4d7e-84bd-2242b4aab589" (UID: "cbe5b378-1d44-4d7e-84bd-2242b4aab589"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 19:26:14.195753 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.195722 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbe5b378-1d44-4d7e-84bd-2242b4aab589-kube-api-access-pjg4c" (OuterVolumeSpecName: "kube-api-access-pjg4c") pod "cbe5b378-1d44-4d7e-84bd-2242b4aab589" (UID: "cbe5b378-1d44-4d7e-84bd-2242b4aab589"). InnerVolumeSpecName "kube-api-access-pjg4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:26:14.294583 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.294550 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjg4c\" (UniqueName: \"kubernetes.io/projected/cbe5b378-1d44-4d7e-84bd-2242b4aab589-kube-api-access-pjg4c\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:26:14.294583 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.294576 2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cbe5b378-1d44-4d7e-84bd-2242b4aab589-config-file\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:26:14.461421 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.461325 2574 generic.go:356] "Generic (PLEG): container finished" podID="cbe5b378-1d44-4d7e-84bd-2242b4aab589" containerID="1deba49ea8efc4a3b6288be2054dd6dc1c0dbd3d0aa7e543bb294804f5f3031d" exitCode=0 Jul 29 19:26:14.461421 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.461383 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" Jul 29 19:26:14.461866 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.461414 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" event={"ID":"cbe5b378-1d44-4d7e-84bd-2242b4aab589","Type":"ContainerDied","Data":"1deba49ea8efc4a3b6288be2054dd6dc1c0dbd3d0aa7e543bb294804f5f3031d"} Jul 29 19:26:14.461866 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.461501 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lw9kj" event={"ID":"cbe5b378-1d44-4d7e-84bd-2242b4aab589","Type":"ContainerDied","Data":"2b6a0c01473d0f2cc710b3f452de6fe3a600a1c24ead18af09febaca8ba3fc32"} Jul 29 19:26:14.461866 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.461552 2574 scope.go:117] "RemoveContainer" containerID="1deba49ea8efc4a3b6288be2054dd6dc1c0dbd3d0aa7e543bb294804f5f3031d" Jul 29 19:26:14.470811 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.470794 2574 scope.go:117] "RemoveContainer" containerID="1deba49ea8efc4a3b6288be2054dd6dc1c0dbd3d0aa7e543bb294804f5f3031d" Jul 29 19:26:14.471075 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:26:14.471051 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1deba49ea8efc4a3b6288be2054dd6dc1c0dbd3d0aa7e543bb294804f5f3031d\": container with ID starting with 1deba49ea8efc4a3b6288be2054dd6dc1c0dbd3d0aa7e543bb294804f5f3031d not found: ID does not exist" containerID="1deba49ea8efc4a3b6288be2054dd6dc1c0dbd3d0aa7e543bb294804f5f3031d" Jul 29 19:26:14.471134 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.471087 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1deba49ea8efc4a3b6288be2054dd6dc1c0dbd3d0aa7e543bb294804f5f3031d"} err="failed to get container status \"1deba49ea8efc4a3b6288be2054dd6dc1c0dbd3d0aa7e543bb294804f5f3031d\": rpc error: code = NotFound desc = could not find container \"1deba49ea8efc4a3b6288be2054dd6dc1c0dbd3d0aa7e543bb294804f5f3031d\": container with ID starting with 1deba49ea8efc4a3b6288be2054dd6dc1c0dbd3d0aa7e543bb294804f5f3031d not found: ID does not exist" Jul 29 19:26:14.484549 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.484506 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lw9kj"] Jul 29 19:26:14.486554 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.486535 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lw9kj"] Jul 29 19:26:14.733697 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:14.733617 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbe5b378-1d44-4d7e-84bd-2242b4aab589" path="/var/lib/kubelet/pods/cbe5b378-1d44-4d7e-84bd-2242b4aab589/volumes" Jul 29 19:26:19.587739 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:19.587692 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:26:19.686147 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:19.686108 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:26:20.035738 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.035707 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-wkslr"] Jul 29 19:26:20.036053 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.036039 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbe5b378-1d44-4d7e-84bd-2242b4aab589" containerName="limitador" Jul 29 19:26:20.036097 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.036053 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbe5b378-1d44-4d7e-84bd-2242b4aab589" containerName="limitador" Jul 29 19:26:20.036097 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.036063 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22651348-7da2-4173-ab14-acf7dfde8a3f" containerName="authorino" Jul 29 19:26:20.036097 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.036068 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="22651348-7da2-4173-ab14-acf7dfde8a3f" containerName="authorino" Jul 29 19:26:20.036195 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.036138 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbe5b378-1d44-4d7e-84bd-2242b4aab589" containerName="limitador" Jul 29 19:26:20.036195 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.036146 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="22651348-7da2-4173-ab14-acf7dfde8a3f" containerName="authorino" Jul 29 19:26:20.040378 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.040360 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wkslr" Jul 29 19:26:20.042611 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.042589 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 29 19:26:20.042723 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.042615 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 29 19:26:20.042723 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.042596 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-rl6gm\"" Jul 29 19:26:20.043008 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.042991 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 29 19:26:20.046884 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.046861 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-wkslr"] Jul 29 19:26:20.060727 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.060697 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:26:20.146600 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.146559 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b1719744-e248-4330-ab56-6c0a28652686-data\") pod \"postgres-69fb4594cf-wkslr\" (UID: \"b1719744-e248-4330-ab56-6c0a28652686\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wkslr" Jul 29 19:26:20.146791 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.146714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd9ts\" (UniqueName: \"kubernetes.io/projected/b1719744-e248-4330-ab56-6c0a28652686-kube-api-access-xd9ts\") pod \"postgres-69fb4594cf-wkslr\" (UID: \"b1719744-e248-4330-ab56-6c0a28652686\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wkslr" Jul 29 19:26:20.248092 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.248045 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b1719744-e248-4330-ab56-6c0a28652686-data\") pod \"postgres-69fb4594cf-wkslr\" (UID: \"b1719744-e248-4330-ab56-6c0a28652686\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wkslr" Jul 29 19:26:20.248299 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.248188 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd9ts\" (UniqueName: \"kubernetes.io/projected/b1719744-e248-4330-ab56-6c0a28652686-kube-api-access-xd9ts\") pod \"postgres-69fb4594cf-wkslr\" (UID: \"b1719744-e248-4330-ab56-6c0a28652686\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wkslr" Jul 29 19:26:20.248423 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.248399 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b1719744-e248-4330-ab56-6c0a28652686-data\") pod \"postgres-69fb4594cf-wkslr\" (UID: \"b1719744-e248-4330-ab56-6c0a28652686\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wkslr" Jul 29 19:26:20.260620 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.260589 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd9ts\" (UniqueName: \"kubernetes.io/projected/b1719744-e248-4330-ab56-6c0a28652686-kube-api-access-xd9ts\") pod \"postgres-69fb4594cf-wkslr\" (UID: \"b1719744-e248-4330-ab56-6c0a28652686\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wkslr" Jul 29 19:26:20.351759 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.351677 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wkslr" Jul 29 19:26:20.485495 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.485469 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-wkslr"] Jul 29 19:26:20.487234 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:26:20.487205 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1719744_e248_4330_ab56_6c0a28652686.slice/crio-fd924aaf920dcb3992164eaf4906861464853b9cd17ecffbb7b04eb6780b45e3 WatchSource:0}: Error finding container fd924aaf920dcb3992164eaf4906861464853b9cd17ecffbb7b04eb6780b45e3: Status 404 returned error can't find the container with id fd924aaf920dcb3992164eaf4906861464853b9cd17ecffbb7b04eb6780b45e3 Jul 29 19:26:20.499151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:20.499122 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wkslr" event={"ID":"b1719744-e248-4330-ab56-6c0a28652686","Type":"ContainerStarted","Data":"fd924aaf920dcb3992164eaf4906861464853b9cd17ecffbb7b04eb6780b45e3"} Jul 29 19:26:25.539198 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:25.539162 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wkslr" event={"ID":"b1719744-e248-4330-ab56-6c0a28652686","Type":"ContainerStarted","Data":"fc4242c2a6c128bbe3f2968f87f71b9beef9451caad2eedbcd51b90b4eb75cb7"} Jul 29 19:26:25.539678 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:25.539266 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wkslr" Jul 29 19:26:25.557482 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:25.557432 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wkslr" podStartSLOduration=0.677729049 podStartE2EDuration="5.557418097s" totalImagesPullingTime="4.879689048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:26:25.555144514 +0000 UTC m=+575.443451753" watchObservedRunningTime="2026-07-29 19:26:25.557418097 +0000 UTC m=+575.445725301" Jul 29 19:26:31.572625 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:31.572598 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wkslr" Jul 29 19:26:31.884337 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:31.884300 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:26:32.117189 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.117154 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pwhc8"] Jul 29 19:26:32.123799 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.123778 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pwhc8" Jul 29 19:26:32.130291 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.130266 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pwhc8"] Jul 29 19:26:32.218021 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.217913 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:26:32.261850 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.261813 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg2dh\" (UniqueName: \"kubernetes.io/projected/9566bbe8-b1bd-4438-a243-9efb9514f443-kube-api-access-vg2dh\") pod \"authorino-5d4b67c446-pwhc8\" (UID: \"9566bbe8-b1bd-4438-a243-9efb9514f443\") " pod="kuadrant-system/authorino-5d4b67c446-pwhc8" Jul 29 19:26:32.342586 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.342552 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pwhc8"] Jul 29 19:26:32.342827 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:26:32.342807 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-vg2dh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-pwhc8" podUID="9566bbe8-b1bd-4438-a243-9efb9514f443" Jul 29 19:26:32.363020 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.362992 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg2dh\" (UniqueName: \"kubernetes.io/projected/9566bbe8-b1bd-4438-a243-9efb9514f443-kube-api-access-vg2dh\") pod \"authorino-5d4b67c446-pwhc8\" (UID: \"9566bbe8-b1bd-4438-a243-9efb9514f443\") " pod="kuadrant-system/authorino-5d4b67c446-pwhc8" Jul 29 19:26:32.370785 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.370757 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5945d5bfd4-9l2rz"] Jul 29 19:26:32.374489 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.374467 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5945d5bfd4-9l2rz" Jul 29 19:26:32.374735 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.374709 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg2dh\" (UniqueName: \"kubernetes.io/projected/9566bbe8-b1bd-4438-a243-9efb9514f443-kube-api-access-vg2dh\") pod \"authorino-5d4b67c446-pwhc8\" (UID: \"9566bbe8-b1bd-4438-a243-9efb9514f443\") " pod="kuadrant-system/authorino-5d4b67c446-pwhc8" Jul 29 19:26:32.384710 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.384687 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5945d5bfd4-9l2rz"] Jul 29 19:26:32.463780 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.463739 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sstq8\" (UniqueName: \"kubernetes.io/projected/348e57a1-4e68-44a5-8ba8-686a8d4c0596-kube-api-access-sstq8\") pod \"authorino-5945d5bfd4-9l2rz\" (UID: \"348e57a1-4e68-44a5-8ba8-686a8d4c0596\") " pod="kuadrant-system/authorino-5945d5bfd4-9l2rz" Jul 29 19:26:32.565064 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.564968 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sstq8\" (UniqueName: \"kubernetes.io/projected/348e57a1-4e68-44a5-8ba8-686a8d4c0596-kube-api-access-sstq8\") pod \"authorino-5945d5bfd4-9l2rz\" (UID: \"348e57a1-4e68-44a5-8ba8-686a8d4c0596\") " pod="kuadrant-system/authorino-5945d5bfd4-9l2rz" Jul 29 19:26:32.572681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.572617 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5945d5bfd4-9l2rz"] Jul 29 19:26:32.573065 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:26:32.572941 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-sstq8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5945d5bfd4-9l2rz" podUID="348e57a1-4e68-44a5-8ba8-686a8d4c0596" Jul 29 19:26:32.574612 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.574583 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sstq8\" (UniqueName: \"kubernetes.io/projected/348e57a1-4e68-44a5-8ba8-686a8d4c0596-kube-api-access-sstq8\") pod \"authorino-5945d5bfd4-9l2rz\" (UID: \"348e57a1-4e68-44a5-8ba8-686a8d4c0596\") " pod="kuadrant-system/authorino-5945d5bfd4-9l2rz" Jul 29 19:26:32.577519 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.577489 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pwhc8" Jul 29 19:26:32.588911 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.588885 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pwhc8" Jul 29 19:26:32.610209 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.610173 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-795c4f5584-8tzgf"] Jul 29 19:26:32.614040 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.614020 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795c4f5584-8tzgf" Jul 29 19:26:32.615997 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.615977 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 29 19:26:32.622007 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.621981 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-795c4f5584-8tzgf"] Jul 29 19:26:32.665766 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.665732 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vg2dh\" (UniqueName: \"kubernetes.io/projected/9566bbe8-b1bd-4438-a243-9efb9514f443-kube-api-access-vg2dh\") pod \"9566bbe8-b1bd-4438-a243-9efb9514f443\" (UID: \"9566bbe8-b1bd-4438-a243-9efb9514f443\") " Jul 29 19:26:32.667883 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.667856 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9566bbe8-b1bd-4438-a243-9efb9514f443-kube-api-access-vg2dh" (OuterVolumeSpecName: "kube-api-access-vg2dh") pod "9566bbe8-b1bd-4438-a243-9efb9514f443" (UID: "9566bbe8-b1bd-4438-a243-9efb9514f443"). InnerVolumeSpecName "kube-api-access-vg2dh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:26:32.766821 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.766792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-224gb\" (UniqueName: \"kubernetes.io/projected/801d955b-481a-4351-8c8e-9596f0919f98-kube-api-access-224gb\") pod \"authorino-795c4f5584-8tzgf\" (UID: \"801d955b-481a-4351-8c8e-9596f0919f98\") " pod="kuadrant-system/authorino-795c4f5584-8tzgf" Jul 29 19:26:32.766942 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.766830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/801d955b-481a-4351-8c8e-9596f0919f98-tls-cert\") pod \"authorino-795c4f5584-8tzgf\" (UID: \"801d955b-481a-4351-8c8e-9596f0919f98\") " pod="kuadrant-system/authorino-795c4f5584-8tzgf" Jul 29 19:26:32.766942 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.766888 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vg2dh\" (UniqueName: \"kubernetes.io/projected/9566bbe8-b1bd-4438-a243-9efb9514f443-kube-api-access-vg2dh\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:26:32.868315 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.868232 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-224gb\" (UniqueName: \"kubernetes.io/projected/801d955b-481a-4351-8c8e-9596f0919f98-kube-api-access-224gb\") pod \"authorino-795c4f5584-8tzgf\" (UID: \"801d955b-481a-4351-8c8e-9596f0919f98\") " pod="kuadrant-system/authorino-795c4f5584-8tzgf" Jul 29 19:26:32.868315 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.868273 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/801d955b-481a-4351-8c8e-9596f0919f98-tls-cert\") pod \"authorino-795c4f5584-8tzgf\" (UID: \"801d955b-481a-4351-8c8e-9596f0919f98\") " pod="kuadrant-system/authorino-795c4f5584-8tzgf" Jul 29 19:26:32.870829 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.870799 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/801d955b-481a-4351-8c8e-9596f0919f98-tls-cert\") pod \"authorino-795c4f5584-8tzgf\" (UID: \"801d955b-481a-4351-8c8e-9596f0919f98\") " pod="kuadrant-system/authorino-795c4f5584-8tzgf" Jul 29 19:26:32.876888 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.876865 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-224gb\" (UniqueName: \"kubernetes.io/projected/801d955b-481a-4351-8c8e-9596f0919f98-kube-api-access-224gb\") pod \"authorino-795c4f5584-8tzgf\" (UID: \"801d955b-481a-4351-8c8e-9596f0919f98\") " pod="kuadrant-system/authorino-795c4f5584-8tzgf" Jul 29 19:26:32.923860 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.923822 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795c4f5584-8tzgf" Jul 29 19:26:32.979752 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:32.979708 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:26:33.058093 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.058067 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-795c4f5584-8tzgf"] Jul 29 19:26:33.059546 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:26:33.059522 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod801d955b_481a_4351_8c8e_9596f0919f98.slice/crio-cb3078a5a7a0fe3fc653cf3fdc68d7ee799cc57340323443a0a1b62defd77ef1 WatchSource:0}: Error finding container cb3078a5a7a0fe3fc653cf3fdc68d7ee799cc57340323443a0a1b62defd77ef1: Status 404 returned error can't find the container with id cb3078a5a7a0fe3fc653cf3fdc68d7ee799cc57340323443a0a1b62defd77ef1 Jul 29 19:26:33.584461 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.584400 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795c4f5584-8tzgf" event={"ID":"801d955b-481a-4351-8c8e-9596f0919f98","Type":"ContainerStarted","Data":"819394f30a473e2f9425802b4c46d0fd43c129ffd96636e2a2ceb8c3ba8906c1"} Jul 29 19:26:33.584461 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.584451 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795c4f5584-8tzgf" event={"ID":"801d955b-481a-4351-8c8e-9596f0919f98","Type":"ContainerStarted","Data":"cb3078a5a7a0fe3fc653cf3fdc68d7ee799cc57340323443a0a1b62defd77ef1"} Jul 29 19:26:33.584977 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.584470 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5945d5bfd4-9l2rz" Jul 29 19:26:33.584977 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.584539 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pwhc8" Jul 29 19:26:33.592072 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.592053 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5945d5bfd4-9l2rz" Jul 29 19:26:33.602336 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.602282 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-795c4f5584-8tzgf" podStartSLOduration=1.291583705 podStartE2EDuration="1.602269793s" totalImagesPullingTime="310.686088ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:26:33.601210714 +0000 UTC m=+583.489517960" watchObservedRunningTime="2026-07-29 19:26:33.602269793 +0000 UTC m=+583.490577020" Jul 29 19:26:33.629348 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.629262 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xkq2l"] Jul 29 19:26:33.629532 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.629461 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-xkq2l" podUID="8413ce67-2613-4ea0-9391-4cf90643ca0d" containerName="authorino" containerID="cri-o://cb31914950e1642d5e238ecafc8211ec968487eaa9bb5bf98a5027db965483d1" gracePeriod=30 Jul 29 19:26:33.646965 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.646922 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pwhc8"] Jul 29 19:26:33.649630 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.649607 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pwhc8"] Jul 29 19:26:33.676208 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.676175 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sstq8\" (UniqueName: \"kubernetes.io/projected/348e57a1-4e68-44a5-8ba8-686a8d4c0596-kube-api-access-sstq8\") pod \"348e57a1-4e68-44a5-8ba8-686a8d4c0596\" (UID: \"348e57a1-4e68-44a5-8ba8-686a8d4c0596\") " Jul 29 19:26:33.678282 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.678255 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/348e57a1-4e68-44a5-8ba8-686a8d4c0596-kube-api-access-sstq8" (OuterVolumeSpecName: "kube-api-access-sstq8") pod "348e57a1-4e68-44a5-8ba8-686a8d4c0596" (UID: "348e57a1-4e68-44a5-8ba8-686a8d4c0596"). InnerVolumeSpecName "kube-api-access-sstq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:26:33.777442 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.777397 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sstq8\" (UniqueName: \"kubernetes.io/projected/348e57a1-4e68-44a5-8ba8-686a8d4c0596-kube-api-access-sstq8\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:26:33.894234 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.894209 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xkq2l" Jul 29 19:26:33.982794 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.982754 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmtsb\" (UniqueName: \"kubernetes.io/projected/8413ce67-2613-4ea0-9391-4cf90643ca0d-kube-api-access-gmtsb\") pod \"8413ce67-2613-4ea0-9391-4cf90643ca0d\" (UID: \"8413ce67-2613-4ea0-9391-4cf90643ca0d\") " Jul 29 19:26:33.984823 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:33.984800 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8413ce67-2613-4ea0-9391-4cf90643ca0d-kube-api-access-gmtsb" (OuterVolumeSpecName: "kube-api-access-gmtsb") pod "8413ce67-2613-4ea0-9391-4cf90643ca0d" (UID: "8413ce67-2613-4ea0-9391-4cf90643ca0d"). InnerVolumeSpecName "kube-api-access-gmtsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:26:34.084050 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:34.084008 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmtsb\" (UniqueName: \"kubernetes.io/projected/8413ce67-2613-4ea0-9391-4cf90643ca0d-kube-api-access-gmtsb\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:26:34.590763 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:34.590724 2574 generic.go:356] "Generic (PLEG): container finished" podID="8413ce67-2613-4ea0-9391-4cf90643ca0d" containerID="cb31914950e1642d5e238ecafc8211ec968487eaa9bb5bf98a5027db965483d1" exitCode=0 Jul 29 19:26:34.591179 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:34.590770 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xkq2l" Jul 29 19:26:34.591179 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:34.590815 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xkq2l" event={"ID":"8413ce67-2613-4ea0-9391-4cf90643ca0d","Type":"ContainerDied","Data":"cb31914950e1642d5e238ecafc8211ec968487eaa9bb5bf98a5027db965483d1"} Jul 29 19:26:34.591179 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:34.590859 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xkq2l" event={"ID":"8413ce67-2613-4ea0-9391-4cf90643ca0d","Type":"ContainerDied","Data":"e2c52a9dafe5cf6f457c89779e63f0c603c79e0bbd0e3f8ee1b5c9caceb82439"} Jul 29 19:26:34.591179 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:34.590875 2574 scope.go:117] "RemoveContainer" containerID="cb31914950e1642d5e238ecafc8211ec968487eaa9bb5bf98a5027db965483d1" Jul 29 19:26:34.591179 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:34.591148 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5945d5bfd4-9l2rz" Jul 29 19:26:34.600533 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:34.600397 2574 scope.go:117] "RemoveContainer" containerID="cb31914950e1642d5e238ecafc8211ec968487eaa9bb5bf98a5027db965483d1" Jul 29 19:26:34.600726 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:26:34.600711 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb31914950e1642d5e238ecafc8211ec968487eaa9bb5bf98a5027db965483d1\": container with ID starting with cb31914950e1642d5e238ecafc8211ec968487eaa9bb5bf98a5027db965483d1 not found: ID does not exist" containerID="cb31914950e1642d5e238ecafc8211ec968487eaa9bb5bf98a5027db965483d1" Jul 29 19:26:34.600798 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:34.600739 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb31914950e1642d5e238ecafc8211ec968487eaa9bb5bf98a5027db965483d1"} err="failed to get container status \"cb31914950e1642d5e238ecafc8211ec968487eaa9bb5bf98a5027db965483d1\": rpc error: code = NotFound desc = could not find container \"cb31914950e1642d5e238ecafc8211ec968487eaa9bb5bf98a5027db965483d1\": container with ID starting with cb31914950e1642d5e238ecafc8211ec968487eaa9bb5bf98a5027db965483d1 not found: ID does not exist" Jul 29 19:26:34.628260 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:34.628223 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5945d5bfd4-9l2rz"] Jul 29 19:26:34.631273 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:34.631205 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5945d5bfd4-9l2rz"] Jul 29 19:26:34.640087 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:34.640061 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xkq2l"] Jul 29 19:26:34.643389 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:34.643365 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xkq2l"] Jul 29 19:26:34.734200 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:34.734170 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="348e57a1-4e68-44a5-8ba8-686a8d4c0596" path="/var/lib/kubelet/pods/348e57a1-4e68-44a5-8ba8-686a8d4c0596/volumes" Jul 29 19:26:34.734402 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:34.734390 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8413ce67-2613-4ea0-9391-4cf90643ca0d" path="/var/lib/kubelet/pods/8413ce67-2613-4ea0-9391-4cf90643ca0d/volumes" Jul 29 19:26:34.734709 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:34.734697 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9566bbe8-b1bd-4438-a243-9efb9514f443" path="/var/lib/kubelet/pods/9566bbe8-b1bd-4438-a243-9efb9514f443/volumes" Jul 29 19:26:38.173844 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:38.173807 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:26:38.590350 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:38.590253 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:26:38.648122 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:38.648087 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:26:41.804904 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:41.804868 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:26:41.905348 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:41.905314 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:26:48.640283 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:48.640241 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:26:48.710542 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:48.710487 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:26:50.533271 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:50.533241 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:26:50.533741 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:50.533241 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:26:50.539034 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:50.539014 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:26:50.539163 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:26:50.539101 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:27:09.849882 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:09.849839 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:27:09.947469 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:09.947434 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:27:10.325231 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.325183 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:27:10.371867 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.371832 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc"] Jul 29 19:27:10.372175 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.372162 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8413ce67-2613-4ea0-9391-4cf90643ca0d" containerName="authorino" Jul 29 19:27:10.372245 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.372176 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8413ce67-2613-4ea0-9391-4cf90643ca0d" containerName="authorino" Jul 29 19:27:10.372301 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.372250 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8413ce67-2613-4ea0-9391-4cf90643ca0d" containerName="authorino" Jul 29 19:27:10.374212 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.374195 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc" Jul 29 19:27:10.376496 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.376476 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 29 19:27:10.388347 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.388325 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc"] Jul 29 19:27:10.490673 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.490641 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbae48e6-54c2-4acb-ad45-3509bc8ad16a-maas-api-tls\") pod \"maas-api-7c7fbc67d6-k2crc\" (UID: \"bbae48e6-54c2-4acb-ad45-3509bc8ad16a\") " pod="odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc" Jul 29 19:27:10.490673 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.490674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgdcd\" (UniqueName: \"kubernetes.io/projected/bbae48e6-54c2-4acb-ad45-3509bc8ad16a-kube-api-access-sgdcd\") pod \"maas-api-7c7fbc67d6-k2crc\" (UID: \"bbae48e6-54c2-4acb-ad45-3509bc8ad16a\") " pod="odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc" Jul 29 19:27:10.490925 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.490718 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbae48e6-54c2-4acb-ad45-3509bc8ad16a-openshift-service-ca\") pod \"maas-api-7c7fbc67d6-k2crc\" (UID: \"bbae48e6-54c2-4acb-ad45-3509bc8ad16a\") " pod="odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc" Jul 29 19:27:10.573754 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.573719 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:27:10.591785 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.591727 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbae48e6-54c2-4acb-ad45-3509bc8ad16a-maas-api-tls\") pod \"maas-api-7c7fbc67d6-k2crc\" (UID: \"bbae48e6-54c2-4acb-ad45-3509bc8ad16a\") " pod="odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc" Jul 29 19:27:10.591785 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.591754 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgdcd\" (UniqueName: \"kubernetes.io/projected/bbae48e6-54c2-4acb-ad45-3509bc8ad16a-kube-api-access-sgdcd\") pod \"maas-api-7c7fbc67d6-k2crc\" (UID: \"bbae48e6-54c2-4acb-ad45-3509bc8ad16a\") " pod="odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc" Jul 29 19:27:10.591909 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.591887 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbae48e6-54c2-4acb-ad45-3509bc8ad16a-openshift-service-ca\") pod \"maas-api-7c7fbc67d6-k2crc\" (UID: \"bbae48e6-54c2-4acb-ad45-3509bc8ad16a\") " pod="odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc" Jul 29 19:27:10.592531 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.592495 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbae48e6-54c2-4acb-ad45-3509bc8ad16a-openshift-service-ca\") pod \"maas-api-7c7fbc67d6-k2crc\" (UID: \"bbae48e6-54c2-4acb-ad45-3509bc8ad16a\") " pod="odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc" Jul 29 19:27:10.594182 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.594166 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbae48e6-54c2-4acb-ad45-3509bc8ad16a-maas-api-tls\") pod \"maas-api-7c7fbc67d6-k2crc\" (UID: \"bbae48e6-54c2-4acb-ad45-3509bc8ad16a\") " pod="odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc" Jul 29 19:27:10.599257 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.599234 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgdcd\" (UniqueName: \"kubernetes.io/projected/bbae48e6-54c2-4acb-ad45-3509bc8ad16a-kube-api-access-sgdcd\") pod \"maas-api-7c7fbc67d6-k2crc\" (UID: \"bbae48e6-54c2-4acb-ad45-3509bc8ad16a\") " pod="odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc" Jul 29 19:27:10.684191 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.684167 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc" Jul 29 19:27:10.823259 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.823231 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc"] Jul 29 19:27:10.825619 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:27:10.825582 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbae48e6_54c2_4acb_ad45_3509bc8ad16a.slice/crio-32c25097457e6aad781ec09271d97381915d5240cadb7287285cfc9f100c4869 WatchSource:0}: Error finding container 32c25097457e6aad781ec09271d97381915d5240cadb7287285cfc9f100c4869: Status 404 returned error can't find the container with id 32c25097457e6aad781ec09271d97381915d5240cadb7287285cfc9f100c4869 Jul 29 19:27:10.826827 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:10.826809 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 19:27:11.089875 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:11.089833 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:27:11.190819 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:11.190784 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:27:11.210015 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:11.209982 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-df4hx"] Jul 29 19:27:11.213216 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:11.213200 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-df4hx" Jul 29 19:27:11.215801 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:11.215778 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 29 19:27:11.229786 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:11.229762 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-df4hx"] Jul 29 19:27:11.298300 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:11.298264 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ece25a0-84ea-485c-b5e2-e69e7e2987c8-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-df4hx\" (UID: \"1ece25a0-84ea-485c-b5e2-e69e7e2987c8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-df4hx" Jul 29 19:27:11.298463 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:11.298336 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbl4d\" (UniqueName: \"kubernetes.io/projected/1ece25a0-84ea-485c-b5e2-e69e7e2987c8-kube-api-access-rbl4d\") pod \"payload-processing-5cc6cd444b-df4hx\" (UID: \"1ece25a0-84ea-485c-b5e2-e69e7e2987c8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-df4hx" Jul 29 19:27:11.399497 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:11.399457 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ece25a0-84ea-485c-b5e2-e69e7e2987c8-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-df4hx\" (UID: \"1ece25a0-84ea-485c-b5e2-e69e7e2987c8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-df4hx" Jul 29 19:27:11.399707 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:11.399635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbl4d\" (UniqueName: \"kubernetes.io/projected/1ece25a0-84ea-485c-b5e2-e69e7e2987c8-kube-api-access-rbl4d\") pod \"payload-processing-5cc6cd444b-df4hx\" (UID: \"1ece25a0-84ea-485c-b5e2-e69e7e2987c8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-df4hx" Jul 29 19:27:11.400181 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:11.400164 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ece25a0-84ea-485c-b5e2-e69e7e2987c8-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-df4hx\" (UID: \"1ece25a0-84ea-485c-b5e2-e69e7e2987c8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-df4hx" Jul 29 19:27:11.408056 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:11.408033 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbl4d\" (UniqueName: \"kubernetes.io/projected/1ece25a0-84ea-485c-b5e2-e69e7e2987c8-kube-api-access-rbl4d\") pod \"payload-processing-5cc6cd444b-df4hx\" (UID: \"1ece25a0-84ea-485c-b5e2-e69e7e2987c8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-df4hx" Jul 29 19:27:11.524247 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:11.524207 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-df4hx" Jul 29 19:27:11.801712 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:11.801583 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc" event={"ID":"bbae48e6-54c2-4acb-ad45-3509bc8ad16a","Type":"ContainerStarted","Data":"32c25097457e6aad781ec09271d97381915d5240cadb7287285cfc9f100c4869"} Jul 29 19:27:11.930229 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:11.930137 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-df4hx"] Jul 29 19:27:11.933782 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:27:11.933759 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ece25a0_84ea_485c_b5e2_e69e7e2987c8.slice/crio-9feb71fd8148804f19adfc37167b0413dbc7836bb9e079eccca8be0cdda709b9 WatchSource:0}: Error finding container 9feb71fd8148804f19adfc37167b0413dbc7836bb9e079eccca8be0cdda709b9: Status 404 returned error can't find the container with id 9feb71fd8148804f19adfc37167b0413dbc7836bb9e079eccca8be0cdda709b9 Jul 29 19:27:12.811236 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:12.810995 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-df4hx" event={"ID":"1ece25a0-84ea-485c-b5e2-e69e7e2987c8","Type":"ContainerStarted","Data":"9feb71fd8148804f19adfc37167b0413dbc7836bb9e079eccca8be0cdda709b9"} Jul 29 19:27:14.825638 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:14.825546 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc" event={"ID":"bbae48e6-54c2-4acb-ad45-3509bc8ad16a","Type":"ContainerStarted","Data":"c1638d2dd59bba005f628eea18d8ed5ab986f906c6dd09b818ee66fc48e43e09"} Jul 29 19:27:14.826080 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:14.825862 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc" Jul 29 19:27:14.827016 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:14.826990 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-df4hx" event={"ID":"1ece25a0-84ea-485c-b5e2-e69e7e2987c8","Type":"ContainerStarted","Data":"e571a12a399a3000c49f4904de8325a2c566eada7a6ab659cf2dddab7a70ff9f"} Jul 29 19:27:14.827461 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:14.827446 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-df4hx" Jul 29 19:27:14.841164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:14.841097 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc" podStartSLOduration=1.281878672 podStartE2EDuration="4.841082098s" totalImagesPullingTime="3.559203426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:27:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:27:14.840282277 +0000 UTC m=+624.728589504" watchObservedRunningTime="2026-07-29 19:27:14.841082098 +0000 UTC m=+624.729389326" Jul 29 19:27:14.856410 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:14.856370 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-df4hx" podStartSLOduration=1.398356949 podStartE2EDuration="3.856357317s" totalImagesPullingTime="2.458000368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:27:14.853955034 +0000 UTC m=+624.742262262" watchObservedRunningTime="2026-07-29 19:27:14.856357317 +0000 UTC m=+624.744664544" Jul 29 19:27:18.856766 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:18.856735 2574 generic.go:356] "Generic (PLEG): container finished" podID="25fa8c35-be85-4183-9249-b06576f2ed0e" containerID="55391d7ceb5a9ff86bd5520bd16cdca8d2288453c89697fca72cb6c369affb1b" exitCode=0 Jul 29 19:27:18.857190 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:18.856809 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" event={"ID":"25fa8c35-be85-4183-9249-b06576f2ed0e","Type":"ContainerDied","Data":"55391d7ceb5a9ff86bd5520bd16cdca8d2288453c89697fca72cb6c369affb1b"} Jul 29 19:27:18.857244 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:18.857188 2574 scope.go:117] "RemoveContainer" containerID="55391d7ceb5a9ff86bd5520bd16cdca8d2288453c89697fca72cb6c369affb1b" Jul 29 19:27:18.858271 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:18.858228 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:27:18.858363 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:18.858349 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:27:18.858405 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:18.858393 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:27:19.864547 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:19.864491 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" event={"ID":"25fa8c35-be85-4183-9249-b06576f2ed0e","Type":"ContainerStarted","Data":"c9485c8b85798d4dd16fdeca04f3dcdc3d67072d5cf19a56b8f659e1ee94d3a9"} Jul 29 19:27:20.193563 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:20.193486 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:27:20.193772 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:20.193749 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-p4wng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 29 19:27:20.193827 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:20.193802 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" podUID="25fa8c35-be85-4183-9249-b06576f2ed0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 29 19:27:20.838003 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:20.837976 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7c7fbc67d6-k2crc" Jul 29 19:27:21.193614 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:21.193576 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-p4wng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 29 19:27:21.194005 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:21.193635 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" podUID="25fa8c35-be85-4183-9249-b06576f2ed0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 29 19:27:21.796992 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:21.796959 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:27:22.193382 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:22.193341 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-p4wng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 29 19:27:22.193648 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:22.193610 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" podUID="25fa8c35-be85-4183-9249-b06576f2ed0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 29 19:27:23.193736 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:23.193697 2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-p4wng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 29 19:27:23.194133 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:23.193764 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" podUID="25fa8c35-be85-4183-9249-b06576f2ed0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 29 19:27:24.197401 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:24.197370 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:27:24.197819 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:24.197720 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:27:24.198541 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:24.198505 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4wng" Jul 29 19:27:25.007709 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:25.007674 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:27:26.840698 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:26.840665 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-df4hx" Jul 29 19:27:26.875031 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:26.874984 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc"] Jul 29 19:27:26.880681 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:26.880665 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:26.882571 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:26.882546 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 29 19:27:26.882736 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:26.882618 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 29 19:27:26.882736 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:26.882623 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-452bp\"" Jul 29 19:27:26.882736 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:26.882666 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 29 19:27:26.886196 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:26.886172 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc"] Jul 29 19:27:26.945865 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:26.945834 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:26.946025 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:26.945900 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:26.946025 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:26.945922 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:26.946025 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:26.945951 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:26.946025 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:26.946016 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2wv5\" (UniqueName: \"kubernetes.io/projected/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-kube-api-access-x2wv5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:26.946200 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:26.946063 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:26.966683 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:26.966658 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:27:27.047060 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:27.047028 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:27.047060 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:27.047069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:27.047275 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:27.047088 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2wv5\" (UniqueName: \"kubernetes.io/projected/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-kube-api-access-x2wv5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:27.047275 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:27.047111 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:27.047275 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:27.047146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:27.047275 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:27.047180 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:27.047478 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:27.047456 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:27.047641 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:27.047614 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:27.047758 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:27.047625 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:27.049496 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:27.049474 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:27.049730 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:27.049713 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:27.055791 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:27.055765 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2wv5\" (UniqueName: \"kubernetes.io/projected/8d85d7bf-1d92-4637-b128-a4e1bbd0e5be-kube-api-access-x2wv5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc\" (UID: \"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:27.194046 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:27.194014 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:27.343530 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:27.337813 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc"] Jul 29 19:27:27.922036 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:27.921983 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" event={"ID":"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be","Type":"ContainerStarted","Data":"66508edebddcc77ca0ef66963b8be6698bd7c0a75b76b7cce511766ba245803b"} Jul 29 19:27:28.928451 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:28.928419 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" event={"ID":"8d85d7bf-1d92-4637-b128-a4e1bbd0e5be","Type":"ContainerStarted","Data":"22d868aecfacee19c95ba2d426c468ef7f4469cc772fed8b53a9a21b2e1ca7c7"} Jul 29 19:27:28.948525 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:28.948473 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" podStartSLOduration=1.892010719 podStartE2EDuration="2.948458929s" totalImagesPullingTime="1.05644821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:27:28.946658657 +0000 UTC m=+638.834965886" watchObservedRunningTime="2026-07-29 19:27:28.948458929 +0000 UTC m=+638.836766156" Jul 29 19:27:35.079277 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:35.079234 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:27:37.194550 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:37.194492 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:37.195040 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:37.194601 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:37.207187 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:37.207162 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:37.993793 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:37.993767 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc" Jul 29 19:27:44.355966 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.355934 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh"] Jul 29 19:27:44.360578 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.360559 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.362410 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.362389 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 29 19:27:44.370262 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.370238 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh"] Jul 29 19:27:44.453386 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.453349 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:27:44.500875 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.500847 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03c80d2b-e5d4-4705-a518-6e7763f49fa1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.501002 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.500877 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03c80d2b-e5d4-4705-a518-6e7763f49fa1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.501002 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.500915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03c80d2b-e5d4-4705-a518-6e7763f49fa1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.501002 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.500982 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03c80d2b-e5d4-4705-a518-6e7763f49fa1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.501108 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.501027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljsfb\" (UniqueName: \"kubernetes.io/projected/03c80d2b-e5d4-4705-a518-6e7763f49fa1-kube-api-access-ljsfb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.501108 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.501091 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03c80d2b-e5d4-4705-a518-6e7763f49fa1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.602111 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.602083 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03c80d2b-e5d4-4705-a518-6e7763f49fa1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.602221 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.602130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03c80d2b-e5d4-4705-a518-6e7763f49fa1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.602221 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.602147 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03c80d2b-e5d4-4705-a518-6e7763f49fa1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.602221 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.602170 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03c80d2b-e5d4-4705-a518-6e7763f49fa1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.602221 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.602203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03c80d2b-e5d4-4705-a518-6e7763f49fa1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.602374 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.602232 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljsfb\" (UniqueName: \"kubernetes.io/projected/03c80d2b-e5d4-4705-a518-6e7763f49fa1-kube-api-access-ljsfb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.602575 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.602550 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03c80d2b-e5d4-4705-a518-6e7763f49fa1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.602642 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.602628 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03c80d2b-e5d4-4705-a518-6e7763f49fa1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.602706 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.602683 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03c80d2b-e5d4-4705-a518-6e7763f49fa1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.604444 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.604425 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03c80d2b-e5d4-4705-a518-6e7763f49fa1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.604606 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.604589 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03c80d2b-e5d4-4705-a518-6e7763f49fa1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.609579 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.609530 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljsfb\" (UniqueName: \"kubernetes.io/projected/03c80d2b-e5d4-4705-a518-6e7763f49fa1-kube-api-access-ljsfb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bkgqh\" (UID: \"03c80d2b-e5d4-4705-a518-6e7763f49fa1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.670693 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.670658 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:44.802721 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:44.802694 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh"] Jul 29 19:27:44.804553 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:27:44.804528 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c80d2b_e5d4_4705_a518_6e7763f49fa1.slice/crio-9f89aa3f40336e9057528c07e4a8091787709fc9ff7fa9d41d9c8fd628f92786 WatchSource:0}: Error finding container 9f89aa3f40336e9057528c07e4a8091787709fc9ff7fa9d41d9c8fd628f92786: Status 404 returned error can't find the container with id 9f89aa3f40336e9057528c07e4a8091787709fc9ff7fa9d41d9c8fd628f92786 Jul 29 19:27:45.020240 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:45.020206 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" event={"ID":"03c80d2b-e5d4-4705-a518-6e7763f49fa1","Type":"ContainerStarted","Data":"9f89aa3f40336e9057528c07e4a8091787709fc9ff7fa9d41d9c8fd628f92786"} Jul 29 19:27:46.027585 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:46.027538 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" event={"ID":"03c80d2b-e5d4-4705-a518-6e7763f49fa1","Type":"ContainerStarted","Data":"4ec240748264070ff6e58d38a32e2bf8ee74212ca9748b9dc1694813ce9f5c37"} Jul 29 19:27:46.057017 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:46.056944 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" podStartSLOduration=1.8124153170000001 podStartE2EDuration="2.056925461s" totalImagesPullingTime="244.510144ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:27:46.05260731 +0000 UTC m=+655.940914542" watchObservedRunningTime="2026-07-29 19:27:46.056925461 +0000 UTC m=+655.945232688" Jul 29 19:27:54.671500 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:54.671463 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:54.671919 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:54.671561 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:54.683994 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:54.683972 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:55.088199 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:55.088121 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bkgqh" Jul 29 19:27:57.488105 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:27:57.488070 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:28:09.769153 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:09.769121 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh"] Jul 29 19:28:09.774854 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:09.774831 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:09.777197 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:09.777179 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 29 19:28:09.784136 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:09.784112 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh"] Jul 29 19:28:09.809188 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:09.809154 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:28:09.915740 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:09.915701 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c8d1376-4f86-47ae-a853-ed616e0137c2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:09.915740 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:09.915741 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c8d1376-4f86-47ae-a853-ed616e0137c2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:09.915998 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:09.915900 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c8d1376-4f86-47ae-a853-ed616e0137c2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:09.915998 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:09.915931 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c8d1376-4f86-47ae-a853-ed616e0137c2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:09.916097 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:09.916027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c8d1376-4f86-47ae-a853-ed616e0137c2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:09.916133 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:09.916098 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw5dd\" (UniqueName: \"kubernetes.io/projected/6c8d1376-4f86-47ae-a853-ed616e0137c2-kube-api-access-nw5dd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:10.016591 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:10.016547 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c8d1376-4f86-47ae-a853-ed616e0137c2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:10.016591 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:10.016591 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c8d1376-4f86-47ae-a853-ed616e0137c2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:10.016910 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:10.016636 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c8d1376-4f86-47ae-a853-ed616e0137c2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:10.016910 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:10.016664 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c8d1376-4f86-47ae-a853-ed616e0137c2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:10.016910 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:10.016727 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c8d1376-4f86-47ae-a853-ed616e0137c2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:10.016910 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:10.016786 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw5dd\" (UniqueName: \"kubernetes.io/projected/6c8d1376-4f86-47ae-a853-ed616e0137c2-kube-api-access-nw5dd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:10.017131 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:10.017084 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c8d1376-4f86-47ae-a853-ed616e0137c2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:10.017188 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:10.017130 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c8d1376-4f86-47ae-a853-ed616e0137c2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:10.017188 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:10.017161 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c8d1376-4f86-47ae-a853-ed616e0137c2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:10.018952 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:10.018932 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c8d1376-4f86-47ae-a853-ed616e0137c2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:10.019063 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:10.019047 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c8d1376-4f86-47ae-a853-ed616e0137c2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:10.025448 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:10.025383 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw5dd\" (UniqueName: \"kubernetes.io/projected/6c8d1376-4f86-47ae-a853-ed616e0137c2-kube-api-access-nw5dd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mlxkh\" (UID: \"6c8d1376-4f86-47ae-a853-ed616e0137c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:10.087328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:10.087298 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:10.229991 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:10.229958 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh"] Jul 29 19:28:10.231630 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:28:10.231604 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8d1376_4f86_47ae_a853_ed616e0137c2.slice/crio-dad3b061006e4f30f4c962af99564e5220ca30da7ea2f062af00583bfac08a02 WatchSource:0}: Error finding container dad3b061006e4f30f4c962af99564e5220ca30da7ea2f062af00583bfac08a02: Status 404 returned error can't find the container with id dad3b061006e4f30f4c962af99564e5220ca30da7ea2f062af00583bfac08a02 Jul 29 19:28:11.166780 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:11.166739 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" event={"ID":"6c8d1376-4f86-47ae-a853-ed616e0137c2","Type":"ContainerStarted","Data":"a84617b73ec8c0b7ec2ba391e92e6b47bcaf8978be04342c1cc67bf943ca8b7e"} Jul 29 19:28:11.167190 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:11.166805 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" event={"ID":"6c8d1376-4f86-47ae-a853-ed616e0137c2","Type":"ContainerStarted","Data":"dad3b061006e4f30f4c962af99564e5220ca30da7ea2f062af00583bfac08a02"} Jul 29 19:28:11.190397 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:11.190343 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" podStartSLOduration=2.001974527 podStartE2EDuration="2.19032823s" totalImagesPullingTime="188.353703ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:28:11.189663273 +0000 UTC m=+681.077970501" watchObservedRunningTime="2026-07-29 19:28:11.19032823 +0000 UTC m=+681.078635457" Jul 29 19:28:15.285733 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:15.285680 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:28:15.349092 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:15.349061 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:28:20.087974 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:20.087938 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:20.088436 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:20.088005 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:20.100990 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:20.100966 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:20.229198 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:20.229170 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mlxkh" Jul 29 19:28:26.788230 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:28:26.788188 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:29:55.231531 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:55.231478 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5555b64fcc-49vwq"] Jul 29 19:29:55.235298 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:55.235282 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5555b64fcc-49vwq" Jul 29 19:29:55.245175 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:55.245148 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5555b64fcc-49vwq"] Jul 29 19:29:55.342719 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:55.342691 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76767554-bb62-40ee-8657-fa96d6279eff-tls-cert\") pod \"authorino-5555b64fcc-49vwq\" (UID: \"76767554-bb62-40ee-8657-fa96d6279eff\") " pod="kuadrant-system/authorino-5555b64fcc-49vwq" Jul 29 19:29:55.342881 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:55.342727 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7msjl\" (UniqueName: \"kubernetes.io/projected/76767554-bb62-40ee-8657-fa96d6279eff-kube-api-access-7msjl\") pod \"authorino-5555b64fcc-49vwq\" (UID: \"76767554-bb62-40ee-8657-fa96d6279eff\") " pod="kuadrant-system/authorino-5555b64fcc-49vwq" Jul 29 19:29:55.443186 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:55.443155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76767554-bb62-40ee-8657-fa96d6279eff-tls-cert\") pod \"authorino-5555b64fcc-49vwq\" (UID: \"76767554-bb62-40ee-8657-fa96d6279eff\") " pod="kuadrant-system/authorino-5555b64fcc-49vwq" Jul 29 19:29:55.443317 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:55.443190 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7msjl\" (UniqueName: \"kubernetes.io/projected/76767554-bb62-40ee-8657-fa96d6279eff-kube-api-access-7msjl\") pod \"authorino-5555b64fcc-49vwq\" (UID: \"76767554-bb62-40ee-8657-fa96d6279eff\") " pod="kuadrant-system/authorino-5555b64fcc-49vwq" Jul 29 19:29:55.445534 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:55.445502 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76767554-bb62-40ee-8657-fa96d6279eff-tls-cert\") pod \"authorino-5555b64fcc-49vwq\" (UID: \"76767554-bb62-40ee-8657-fa96d6279eff\") " pod="kuadrant-system/authorino-5555b64fcc-49vwq" Jul 29 19:29:55.450747 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:55.450728 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7msjl\" (UniqueName: \"kubernetes.io/projected/76767554-bb62-40ee-8657-fa96d6279eff-kube-api-access-7msjl\") pod \"authorino-5555b64fcc-49vwq\" (UID: \"76767554-bb62-40ee-8657-fa96d6279eff\") " pod="kuadrant-system/authorino-5555b64fcc-49vwq" Jul 29 19:29:55.545782 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:55.545715 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5555b64fcc-49vwq" Jul 29 19:29:55.622116 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:55.622081 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:29:55.683618 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:55.683580 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5555b64fcc-49vwq"] Jul 29 19:29:55.688361 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:55.688316 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:29:55.688930 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:29:55.688900 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76767554_bb62_40ee_8657_fa96d6279eff.slice/crio-e606ac5b189459dac240af2aef785dc4674365da26b148a06e176e429877d7c9 WatchSource:0}: Error finding container e606ac5b189459dac240af2aef785dc4674365da26b148a06e176e429877d7c9: Status 404 returned error can't find the container with id e606ac5b189459dac240af2aef785dc4674365da26b148a06e176e429877d7c9 Jul 29 19:29:55.736020 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:55.735991 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5555b64fcc-49vwq" event={"ID":"76767554-bb62-40ee-8657-fa96d6279eff","Type":"ContainerStarted","Data":"e606ac5b189459dac240af2aef785dc4674365da26b148a06e176e429877d7c9"} Jul 29 19:29:56.743406 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:56.743360 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5555b64fcc-49vwq" event={"ID":"76767554-bb62-40ee-8657-fa96d6279eff","Type":"ContainerStarted","Data":"5187cd268066acb04efb214100f508f3c883eb5edb2cc512a9ee10b585172e14"} Jul 29 19:29:56.769958 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:56.769900 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5555b64fcc-49vwq" podStartSLOduration=1.397653167 podStartE2EDuration="1.769882508s" totalImagesPullingTime="372.229341ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:29:56.767253576 +0000 UTC m=+786.655560807" watchObservedRunningTime="2026-07-29 19:29:56.769882508 +0000 UTC m=+786.658189877" Jul 29 19:29:56.774327 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:56.774288 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:29:56.874812 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:56.874665 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-795c4f5584-8tzgf"] Jul 29 19:29:56.875017 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:56.874979 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-795c4f5584-8tzgf" podUID="801d955b-481a-4351-8c8e-9596f0919f98" containerName="authorino" containerID="cri-o://819394f30a473e2f9425802b4c46d0fd43c129ffd96636e2a2ceb8c3ba8906c1" gracePeriod=30 Jul 29 19:29:56.888625 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:56.888581 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:29:57.136171 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:57.136141 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795c4f5584-8tzgf" Jul 29 19:29:57.160226 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:57.160193 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-224gb\" (UniqueName: \"kubernetes.io/projected/801d955b-481a-4351-8c8e-9596f0919f98-kube-api-access-224gb\") pod \"801d955b-481a-4351-8c8e-9596f0919f98\" (UID: \"801d955b-481a-4351-8c8e-9596f0919f98\") " Jul 29 19:29:57.160456 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:57.160255 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/801d955b-481a-4351-8c8e-9596f0919f98-tls-cert\") pod \"801d955b-481a-4351-8c8e-9596f0919f98\" (UID: \"801d955b-481a-4351-8c8e-9596f0919f98\") " Jul 29 19:29:57.162974 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:57.162944 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/801d955b-481a-4351-8c8e-9596f0919f98-kube-api-access-224gb" (OuterVolumeSpecName: "kube-api-access-224gb") pod "801d955b-481a-4351-8c8e-9596f0919f98" (UID: "801d955b-481a-4351-8c8e-9596f0919f98"). InnerVolumeSpecName "kube-api-access-224gb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:29:57.173698 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:57.173633 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/801d955b-481a-4351-8c8e-9596f0919f98-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "801d955b-481a-4351-8c8e-9596f0919f98" (UID: "801d955b-481a-4351-8c8e-9596f0919f98"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 19:29:57.261488 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:57.261404 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-224gb\" (UniqueName: \"kubernetes.io/projected/801d955b-481a-4351-8c8e-9596f0919f98-kube-api-access-224gb\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:29:57.261488 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:57.261434 2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/801d955b-481a-4351-8c8e-9596f0919f98-tls-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:29:57.754649 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:57.754611 2574 generic.go:356] "Generic (PLEG): container finished" podID="801d955b-481a-4351-8c8e-9596f0919f98" containerID="819394f30a473e2f9425802b4c46d0fd43c129ffd96636e2a2ceb8c3ba8906c1" exitCode=0 Jul 29 19:29:57.758532 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:57.755351 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795c4f5584-8tzgf" Jul 29 19:29:57.764060 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:57.764032 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795c4f5584-8tzgf" event={"ID":"801d955b-481a-4351-8c8e-9596f0919f98","Type":"ContainerDied","Data":"819394f30a473e2f9425802b4c46d0fd43c129ffd96636e2a2ceb8c3ba8906c1"} Jul 29 19:29:57.764574 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:57.764550 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795c4f5584-8tzgf" event={"ID":"801d955b-481a-4351-8c8e-9596f0919f98","Type":"ContainerDied","Data":"cb3078a5a7a0fe3fc653cf3fdc68d7ee799cc57340323443a0a1b62defd77ef1"} Jul 29 19:29:57.764742 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:57.764707 2574 scope.go:117] "RemoveContainer" containerID="819394f30a473e2f9425802b4c46d0fd43c129ffd96636e2a2ceb8c3ba8906c1" Jul 29 19:29:57.786341 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:57.786311 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-795c4f5584-8tzgf"] Jul 29 19:29:57.787240 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:57.787203 2574 scope.go:117] "RemoveContainer" containerID="819394f30a473e2f9425802b4c46d0fd43c129ffd96636e2a2ceb8c3ba8906c1" Jul 29 19:29:57.787581 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:29:57.787559 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"819394f30a473e2f9425802b4c46d0fd43c129ffd96636e2a2ceb8c3ba8906c1\": container with ID starting with 819394f30a473e2f9425802b4c46d0fd43c129ffd96636e2a2ceb8c3ba8906c1 not found: ID does not exist" containerID="819394f30a473e2f9425802b4c46d0fd43c129ffd96636e2a2ceb8c3ba8906c1" Jul 29 19:29:57.787673 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:57.787590 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"819394f30a473e2f9425802b4c46d0fd43c129ffd96636e2a2ceb8c3ba8906c1"} err="failed to get container status \"819394f30a473e2f9425802b4c46d0fd43c129ffd96636e2a2ceb8c3ba8906c1\": rpc error: code = NotFound desc = could not find container \"819394f30a473e2f9425802b4c46d0fd43c129ffd96636e2a2ceb8c3ba8906c1\": container with ID starting with 819394f30a473e2f9425802b4c46d0fd43c129ffd96636e2a2ceb8c3ba8906c1 not found: ID does not exist" Jul 29 19:29:57.792399 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:57.792375 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-795c4f5584-8tzgf"] Jul 29 19:29:58.734554 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:29:58.734499 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="801d955b-481a-4351-8c8e-9596f0919f98" path="/var/lib/kubelet/pods/801d955b-481a-4351-8c8e-9596f0919f98/volumes" Jul 29 19:30:01.163938 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:30:01.163883 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:30:12.021782 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:30:12.021746 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:30:12.122439 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:30:12.122407 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:30:12.222043 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:30:12.222005 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:30:36.307461 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:30:36.307419 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:30:48.755975 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:30:48.755935 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:30:56.817169 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:30:56.817126 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:31:50.574078 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:31:50.573763 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:31:50.574078 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:31:50.573966 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:31:50.580142 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:31:50.580122 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:31:50.580792 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:31:50.580771 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:32:07.864216 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:32:07.864174 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:32:09.098308 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:32:09.098269 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:32:14.148120 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:32:14.148078 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:32:14.209831 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:32:14.209793 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:32:45.832279 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:32:45.832242 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:32:47.325778 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:32:47.325740 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:32:52.020713 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:32:52.020671 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:32:52.122925 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:32:52.122890 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:32:52.221207 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:32:52.221161 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:32:52.386451 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:32:52.386411 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:32:58.387104 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:32:58.387065 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:32:58.449559 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:32:58.449517 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:34:39.730571 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:34:39.730536 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:34:39.786206 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:34:39.786176 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:36:50.611991 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:36:50.611911 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:36:50.614198 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:36:50.614172 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:36:50.617768 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:36:50.617751 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:36:50.619408 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:36:50.619388 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:37:08.114213 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:37:08.114174 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:39:46.364524 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:39:46.364437 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:40:06.365335 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:40:06.365288 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:41:02.408825 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:41:02.408788 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:41:11.005082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:41:11.005048 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:41:31.239493 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:41:31.239456 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:41:32.911228 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:41:32.911201 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:41:50.656132 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:41:50.656102 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:41:50.658870 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:41:50.658846 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:41:50.661865 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:41:50.661847 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:41:50.664391 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:41:50.664372 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:44:45.127946 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:44:45.127907 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:44:45.446269 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:44:45.446229 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:07.946773 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:07.946725 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:10.823671 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:10.823634 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:10.922070 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:10.922033 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:11.330440 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:11.330407 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:17.914109 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:17.914008 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:18.015632 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.015563 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:18.160202 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.160159 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:18.438471 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.438432 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz"] Jul 29 19:45:18.438918 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.438899 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="801d955b-481a-4351-8c8e-9596f0919f98" containerName="authorino" Jul 29 19:45:18.439014 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.438921 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="801d955b-481a-4351-8c8e-9596f0919f98" containerName="authorino" Jul 29 19:45:18.439072 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.439059 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="801d955b-481a-4351-8c8e-9596f0919f98" containerName="authorino" Jul 29 19:45:18.442354 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.442334 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.444531 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.444486 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e9d45d7a-openshift-default-dockercfg-qx86x\"" Jul 29 19:45:18.460064 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.460038 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz"] Jul 29 19:45:18.475589 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.475502 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:18.535423 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.535392 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-credential-socket\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.535630 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.535433 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-envoy\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.535630 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.535459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-482dg\" (UniqueName: \"kubernetes.io/projected/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-kube-api-access-482dg\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.535630 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.535484 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-workload-socket\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.535630 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.535549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istiod-ca-cert\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.535630 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.535596 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-podinfo\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.535630 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.535623 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-workload-certs\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.535892 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.535674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-data\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.535892 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.535695 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-token\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.636886 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.636847 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-workload-socket\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.637086 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.636892 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istiod-ca-cert\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.637086 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.636950 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-podinfo\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.637086 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.636972 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-workload-certs\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.637086 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.637038 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-data\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.637086 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.637063 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-token\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.637366 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.637106 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-credential-socket\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.637366 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.637144 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-envoy\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.637366 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.637177 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-482dg\" (UniqueName: \"kubernetes.io/projected/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-kube-api-access-482dg\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.637366 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.637310 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-workload-socket\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.637584 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.637378 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-data\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.637584 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.637499 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-credential-socket\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.637675 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.637652 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-workload-certs\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.638067 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.638046 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istiod-ca-cert\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.639417 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.639399 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-podinfo\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.639495 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.639437 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-envoy\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.652594 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.652565 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-token\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.653598 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.653582 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-482dg\" (UniqueName: \"kubernetes.io/projected/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-kube-api-access-482dg\") pod \"e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.752793 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.752712 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:18.824608 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.824542 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:18.906075 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.906039 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz"] Jul 29 19:45:18.907741 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:45:18.907710 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fffdcd4_1e29_45ba_ab6d_52a03ea7f187.slice/crio-af19d72256a4519a07d17e02f4c9b5f791e93be6c463f8974f1111d3d9380077 WatchSource:0}: Error finding container af19d72256a4519a07d17e02f4c9b5f791e93be6c463f8974f1111d3d9380077: Status 404 returned error can't find the container with id af19d72256a4519a07d17e02f4c9b5f791e93be6c463f8974f1111d3d9380077 Jul 29 19:45:18.909833 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.909796 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:45:18.909946 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.909877 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:45:18.909946 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:18.909924 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:45:19.865588 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:19.865546 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" event={"ID":"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187","Type":"ContainerStarted","Data":"290988978c4b6243415b208e4b5ad39af2f22f9f2bdfd70bbeb2245f47723edf"} Jul 29 19:45:19.865974 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:19.865662 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" event={"ID":"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187","Type":"ContainerStarted","Data":"af19d72256a4519a07d17e02f4c9b5f791e93be6c463f8974f1111d3d9380077"} Jul 29 19:45:19.895006 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:19.894954 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" podStartSLOduration=1.894939889 podStartE2EDuration="1.894939889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:45:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:45:19.89457267 +0000 UTC m=+1709.782879899" watchObservedRunningTime="2026-07-29 19:45:19.894939889 +0000 UTC m=+1709.783247117" Jul 29 19:45:20.753089 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:20.753059 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:20.758109 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:20.758081 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:20.872181 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:20.872149 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:20.873072 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:20.873053 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:21.255212 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:21.255168 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:21.333051 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:21.333019 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:21.399248 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:21.399201 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:21.498164 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:21.498129 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:21.923550 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:21.923498 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:22.016534 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:22.016468 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:35.873601 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:35.873564 2574 patch_prober.go:28] interesting pod/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 29 19:45:35.874013 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:35.873634 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" podUID="1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 29 19:45:35.957998 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:35.957905 2574 generic.go:356] "Generic (PLEG): container finished" podID="1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" containerID="290988978c4b6243415b208e4b5ad39af2f22f9f2bdfd70bbeb2245f47723edf" exitCode=0 Jul 29 19:45:35.958157 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:35.957989 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" event={"ID":"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187","Type":"ContainerDied","Data":"290988978c4b6243415b208e4b5ad39af2f22f9f2bdfd70bbeb2245f47723edf"} Jul 29 19:45:35.958409 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:35.958394 2574 scope.go:117] "RemoveContainer" containerID="290988978c4b6243415b208e4b5ad39af2f22f9f2bdfd70bbeb2245f47723edf" Jul 29 19:45:35.959395 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:35.959369 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:45:35.959448 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:35.959434 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:45:35.959483 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:35.959467 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:45:36.965634 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:36.965599 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" event={"ID":"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187","Type":"ContainerStarted","Data":"0db4a659bf544e5650aa2e51d07a05f1274f1ac0dbc0ea58de6f21354709e62a"} Jul 29 19:45:37.753708 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:37.753665 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:37.753913 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:37.753879 2574 patch_prober.go:28] interesting pod/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 29 19:45:37.753968 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:37.753929 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" podUID="1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 29 19:45:38.754078 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:38.754043 2574 patch_prober.go:28] interesting pod/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 29 19:45:38.754485 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:38.754124 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" podUID="1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 29 19:45:39.753805 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:39.753763 2574 patch_prober.go:28] interesting pod/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 29 19:45:39.753984 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:39.753837 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" podUID="1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 29 19:45:40.754067 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:40.754032 2574 patch_prober.go:28] interesting pod/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 29 19:45:40.754587 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:40.754104 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" podUID="1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 29 19:45:41.757804 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:41.757774 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:41.758288 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:41.758164 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:41.758827 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:41.758805 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:51.911319 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:51.911258 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:51.980317 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:51.980285 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:52.083055 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:52.083020 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:52.148400 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:52.148363 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:52.244886 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:52.244791 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz"] Jul 29 19:45:52.245070 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:52.244990 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" podUID="1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" containerName="istio-proxy" containerID="cri-o://0db4a659bf544e5650aa2e51d07a05f1274f1ac0dbc0ea58de6f21354709e62a" gracePeriod=30 Jul 29 19:45:52.253290 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:52.253256 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:52.479980 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:52.479940 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:52.711931 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:52.711884 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:52.819209 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:52.819166 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:52.925862 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:52.925825 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:53.250370 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:53.250228 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:53.338707 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:53.338671 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:56.760841 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:56.760804 2574 patch_prober.go:28] interesting pod/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 29 19:45:56.761225 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:56.760872 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" podUID="1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 19:45:57.502115 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.502092 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:57.592152 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.592068 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-credential-socket\") pod \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " Jul 29 19:45:57.592152 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.592107 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-482dg\" (UniqueName: \"kubernetes.io/projected/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-kube-api-access-482dg\") pod \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " Jul 29 19:45:57.592152 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.592136 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-podinfo\") pod \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " Jul 29 19:45:57.592442 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.592206 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-envoy\") pod \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " Jul 29 19:45:57.592442 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.592231 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-workload-socket\") pod \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " Jul 29 19:45:57.592442 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.592259 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-workload-certs\") pod \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " Jul 29 19:45:57.592442 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.592332 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istiod-ca-cert\") pod \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " Jul 29 19:45:57.592442 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.592356 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-token\") pod \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " Jul 29 19:45:57.592442 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.592361 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" (UID: "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:45:57.592442 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.592393 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-data\") pod \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\" (UID: \"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187\") " Jul 29 19:45:57.592847 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.592602 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" (UID: "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:45:57.592847 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.592703 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" (UID: "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 19:45:57.592847 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.592771 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:45:57.592847 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.592790 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:45:57.593060 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.592940 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" (UID: "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:45:57.593448 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.593427 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-data" (OuterVolumeSpecName: "istio-data") pod "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" (UID: "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:45:57.594546 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.594526 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" (UID: "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:45:57.594644 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.594627 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" (UID: "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 19:45:57.594805 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.594775 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-kube-api-access-482dg" (OuterVolumeSpecName: "kube-api-access-482dg") pod "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" (UID: "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187"). InnerVolumeSpecName "kube-api-access-482dg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:45:57.594805 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.594793 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-token" (OuterVolumeSpecName: "istio-token") pod "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" (UID: "1fffdcd4-1e29-45ba-ab6d-52a03ea7f187"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:45:57.693354 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.693316 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-482dg\" (UniqueName: \"kubernetes.io/projected/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-kube-api-access-482dg\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:45:57.693354 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.693353 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:45:57.693354 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.693363 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:45:57.693614 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.693372 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:45:57.693614 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.693380 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:45:57.693614 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.693388 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:45:57.693614 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:57.693397 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:45:58.108796 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.108763 2574 generic.go:356] "Generic (PLEG): container finished" podID="1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" containerID="0db4a659bf544e5650aa2e51d07a05f1274f1ac0dbc0ea58de6f21354709e62a" exitCode=0 Jul 29 19:45:58.109210 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.108810 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" Jul 29 19:45:58.109210 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.108836 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" event={"ID":"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187","Type":"ContainerDied","Data":"0db4a659bf544e5650aa2e51d07a05f1274f1ac0dbc0ea58de6f21354709e62a"} Jul 29 19:45:58.109210 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.108878 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz" event={"ID":"1fffdcd4-1e29-45ba-ab6d-52a03ea7f187","Type":"ContainerDied","Data":"af19d72256a4519a07d17e02f4c9b5f791e93be6c463f8974f1111d3d9380077"} Jul 29 19:45:58.109210 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.108899 2574 scope.go:117] "RemoveContainer" containerID="0db4a659bf544e5650aa2e51d07a05f1274f1ac0dbc0ea58de6f21354709e62a" Jul 29 19:45:58.118987 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.118969 2574 scope.go:117] "RemoveContainer" containerID="290988978c4b6243415b208e4b5ad39af2f22f9f2bdfd70bbeb2245f47723edf" Jul 29 19:45:58.126748 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.126730 2574 scope.go:117] "RemoveContainer" containerID="0db4a659bf544e5650aa2e51d07a05f1274f1ac0dbc0ea58de6f21354709e62a" Jul 29 19:45:58.127002 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:45:58.126983 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0db4a659bf544e5650aa2e51d07a05f1274f1ac0dbc0ea58de6f21354709e62a\": container with ID starting with 0db4a659bf544e5650aa2e51d07a05f1274f1ac0dbc0ea58de6f21354709e62a not found: ID does not exist" containerID="0db4a659bf544e5650aa2e51d07a05f1274f1ac0dbc0ea58de6f21354709e62a" Jul 29 19:45:58.127064 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.127011 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0db4a659bf544e5650aa2e51d07a05f1274f1ac0dbc0ea58de6f21354709e62a"} err="failed to get container status \"0db4a659bf544e5650aa2e51d07a05f1274f1ac0dbc0ea58de6f21354709e62a\": rpc error: code = NotFound desc = could not find container \"0db4a659bf544e5650aa2e51d07a05f1274f1ac0dbc0ea58de6f21354709e62a\": container with ID starting with 0db4a659bf544e5650aa2e51d07a05f1274f1ac0dbc0ea58de6f21354709e62a not found: ID does not exist" Jul 29 19:45:58.127064 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.127028 2574 scope.go:117] "RemoveContainer" containerID="290988978c4b6243415b208e4b5ad39af2f22f9f2bdfd70bbeb2245f47723edf" Jul 29 19:45:58.127255 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:45:58.127235 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"290988978c4b6243415b208e4b5ad39af2f22f9f2bdfd70bbeb2245f47723edf\": container with ID starting with 290988978c4b6243415b208e4b5ad39af2f22f9f2bdfd70bbeb2245f47723edf not found: ID does not exist" containerID="290988978c4b6243415b208e4b5ad39af2f22f9f2bdfd70bbeb2245f47723edf" Jul 29 19:45:58.127295 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.127262 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"290988978c4b6243415b208e4b5ad39af2f22f9f2bdfd70bbeb2245f47723edf"} err="failed to get container status \"290988978c4b6243415b208e4b5ad39af2f22f9f2bdfd70bbeb2245f47723edf\": rpc error: code = NotFound desc = could not find container \"290988978c4b6243415b208e4b5ad39af2f22f9f2bdfd70bbeb2245f47723edf\": container with ID starting with 290988978c4b6243415b208e4b5ad39af2f22f9f2bdfd70bbeb2245f47723edf not found: ID does not exist" Jul 29 19:45:58.131160 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.131139 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz"] Jul 29 19:45:58.134809 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.134786 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e9d45d7a-openshift-default-5f4898764b-2gbgz"] Jul 29 19:45:58.734063 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.734028 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" path="/var/lib/kubelet/pods/1fffdcd4-1e29-45ba-ab6d-52a03ea7f187/volumes" Jul 29 19:45:58.810967 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.810931 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:58.897099 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.897063 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87"] Jul 29 19:45:58.897471 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.897458 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" containerName="istio-proxy" Jul 29 19:45:58.897534 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.897473 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" containerName="istio-proxy" Jul 29 19:45:58.897580 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.897557 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" containerName="istio-proxy" Jul 29 19:45:58.897580 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.897564 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" containerName="istio-proxy" Jul 29 19:45:58.900805 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.900788 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" Jul 29 19:45:58.910900 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.910876 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-9a86149a-serving-cert\"" Jul 29 19:45:58.911035 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.910878 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6wzbz\"" Jul 29 19:45:58.913770 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.913749 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87"] Jul 29 19:45:58.989531 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:58.989422 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:59.007569 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:59.007536 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2scx\" (UniqueName: \"kubernetes.io/projected/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-kube-api-access-t2scx\") pod \"maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87\" (UID: \"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" Jul 29 19:45:59.007749 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:59.007597 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-openshift-service-ca\") pod \"maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87\" (UID: \"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" Jul 29 19:45:59.007749 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:59.007647 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-maas-api-tls\") pod \"maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87\" (UID: \"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" Jul 29 19:45:59.108883 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:59.108836 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2scx\" (UniqueName: \"kubernetes.io/projected/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-kube-api-access-t2scx\") pod \"maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87\" (UID: \"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" Jul 29 19:45:59.109381 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:59.108919 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-openshift-service-ca\") pod \"maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87\" (UID: \"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" Jul 29 19:45:59.109381 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:59.108955 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-maas-api-tls\") pod \"maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87\" (UID: \"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" Jul 29 19:45:59.109381 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:45:59.109166 2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-serving-cert: secret "maas-api-e2e-migrate-9a86149a-serving-cert" not found Jul 29 19:45:59.109381 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:45:59.109260 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-maas-api-tls podName:b91cc4ae-38ac-4cf9-a670-e88247fb2ff2 nodeName:}" failed. No retries permitted until 2026-07-29 19:45:59.609237408 +0000 UTC m=+1749.497544617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-maas-api-tls") pod "maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" (UID: "b91cc4ae-38ac-4cf9-a670-e88247fb2ff2") : secret "maas-api-e2e-migrate-9a86149a-serving-cert" not found Jul 29 19:45:59.109829 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:59.109807 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-openshift-service-ca\") pod \"maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87\" (UID: \"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" Jul 29 19:45:59.118473 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:59.118440 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2scx\" (UniqueName: \"kubernetes.io/projected/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-kube-api-access-t2scx\") pod \"maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87\" (UID: \"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" Jul 29 19:45:59.226862 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:59.226824 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:59.471638 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:59.471607 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:59.566808 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:59.566768 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:45:59.614029 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:59.613999 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-maas-api-tls\") pod \"maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87\" (UID: \"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" Jul 29 19:45:59.616615 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:59.616589 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-maas-api-tls\") pod \"maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87\" (UID: \"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" Jul 29 19:45:59.811734 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:59.811645 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" Jul 29 19:45:59.949358 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:59.949320 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87"] Jul 29 19:45:59.950274 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:45:59.950253 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91cc4ae_38ac_4cf9_a670_e88247fb2ff2.slice/crio-e1d8ba7ecdd83e5fad692132d9d9b02e429181d74de5351f53fcbb3b464ae962 WatchSource:0}: Error finding container e1d8ba7ecdd83e5fad692132d9d9b02e429181d74de5351f53fcbb3b464ae962: Status 404 returned error can't find the container with id e1d8ba7ecdd83e5fad692132d9d9b02e429181d74de5351f53fcbb3b464ae962 Jul 29 19:45:59.952099 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:45:59.952080 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 19:46:00.122608 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:00.122504 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" event={"ID":"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2","Type":"ContainerStarted","Data":"e1d8ba7ecdd83e5fad692132d9d9b02e429181d74de5351f53fcbb3b464ae962"} Jul 29 19:46:01.130175 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:01.130138 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" event={"ID":"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2","Type":"ContainerStarted","Data":"9ea18461f4f56dcfe2e279009a6f9513959486495b1910cbf812352806261a75"} Jul 29 19:46:01.130593 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:01.130202 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" Jul 29 19:46:01.148868 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:01.148816 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" podStartSLOduration=2.6318979430000002 podStartE2EDuration="3.148800914s" totalImagesPullingTime="516.902971ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:45:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:46:01.14671312 +0000 UTC m=+1751.035020346" watchObservedRunningTime="2026-07-29 19:46:01.148800914 +0000 UTC m=+1751.037108141" Jul 29 19:46:07.141610 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:07.141580 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" Jul 29 19:46:30.148078 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.148039 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87"] Jul 29 19:46:30.148753 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.148342 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" podUID="b91cc4ae-38ac-4cf9-a670-e88247fb2ff2" containerName="maas-api" containerID="cri-o://9ea18461f4f56dcfe2e279009a6f9513959486495b1910cbf812352806261a75" gracePeriod=30 Jul 29 19:46:30.172973 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.172949 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:46:30.241043 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.241005 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:46:30.302964 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.302932 2574 generic.go:356] "Generic (PLEG): container finished" podID="b91cc4ae-38ac-4cf9-a670-e88247fb2ff2" containerID="9ea18461f4f56dcfe2e279009a6f9513959486495b1910cbf812352806261a75" exitCode=0 Jul 29 19:46:30.303121 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.303009 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" event={"ID":"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2","Type":"ContainerDied","Data":"9ea18461f4f56dcfe2e279009a6f9513959486495b1910cbf812352806261a75"} Jul 29 19:46:30.341996 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.341852 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:46:30.398790 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.398726 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" Jul 29 19:46:30.422587 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.421359 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:46:30.485245 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.485212 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-openshift-service-ca\") pod \"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2\" (UID: \"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2\") " Jul 29 19:46:30.485444 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.485297 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2scx\" (UniqueName: \"kubernetes.io/projected/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-kube-api-access-t2scx\") pod \"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2\" (UID: \"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2\") " Jul 29 19:46:30.485444 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.485392 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-maas-api-tls\") pod \"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2\" (UID: \"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2\") " Jul 29 19:46:30.485689 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.485664 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b91cc4ae-38ac-4cf9-a670-e88247fb2ff2" (UID: "b91cc4ae-38ac-4cf9-a670-e88247fb2ff2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 19:46:30.488148 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.488123 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b91cc4ae-38ac-4cf9-a670-e88247fb2ff2" (UID: "b91cc4ae-38ac-4cf9-a670-e88247fb2ff2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 19:46:30.488148 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.488148 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-kube-api-access-t2scx" (OuterVolumeSpecName: "kube-api-access-t2scx") pod "b91cc4ae-38ac-4cf9-a670-e88247fb2ff2" (UID: "b91cc4ae-38ac-4cf9-a670-e88247fb2ff2"). InnerVolumeSpecName "kube-api-access-t2scx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:46:30.513060 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.513032 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:46:30.586901 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.586869 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2scx\" (UniqueName: \"kubernetes.io/projected/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-kube-api-access-t2scx\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:46:30.586901 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.586896 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-maas-api-tls\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:46:30.586901 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.586905 2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2-openshift-service-ca\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:46:30.732059 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.731967 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:46:30.946847 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:30.946812 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:46:31.238398 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.238361 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr"] Jul 29 19:46:31.238826 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.238813 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" containerName="istio-proxy" Jul 29 19:46:31.238826 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.238827 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fffdcd4-1e29-45ba-ab6d-52a03ea7f187" containerName="istio-proxy" Jul 29 19:46:31.238920 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.238853 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b91cc4ae-38ac-4cf9-a670-e88247fb2ff2" containerName="maas-api" Jul 29 19:46:31.238920 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.238859 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b91cc4ae-38ac-4cf9-a670-e88247fb2ff2" containerName="maas-api" Jul 29 19:46:31.239032 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.238944 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b91cc4ae-38ac-4cf9-a670-e88247fb2ff2" containerName="maas-api" Jul 29 19:46:31.241484 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.241465 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.243481 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.243461 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2f25c52f-openshift-default-dockercfg-6p9zj\"" Jul 29 19:46:31.256117 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.256096 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr"] Jul 29 19:46:31.262101 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.262066 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:46:31.292818 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.292788 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-workload-certs\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.292983 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.292824 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66b89\" (UniqueName: \"kubernetes.io/projected/1c15c1c8-5094-4411-a6fb-9a489c64e218-kube-api-access-66b89\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.292983 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.292850 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-envoy\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.292983 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.292927 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-data\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.293143 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.293002 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-podinfo\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.293143 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.293042 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c15c1c8-5094-4411-a6fb-9a489c64e218-istiod-ca-cert\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.293143 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.293117 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-token\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.293248 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.293179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-workload-socket\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.293248 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.293194 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-credential-socket\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.310394 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.310367 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" Jul 29 19:46:31.310394 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.310373 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87" event={"ID":"b91cc4ae-38ac-4cf9-a670-e88247fb2ff2","Type":"ContainerDied","Data":"e1d8ba7ecdd83e5fad692132d9d9b02e429181d74de5351f53fcbb3b464ae962"} Jul 29 19:46:31.310605 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.310437 2574 scope.go:117] "RemoveContainer" containerID="9ea18461f4f56dcfe2e279009a6f9513959486495b1910cbf812352806261a75" Jul 29 19:46:31.328089 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.328061 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87"] Jul 29 19:46:31.330535 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.330495 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9a86149a-756db49ddc-rxg87"] Jul 29 19:46:31.393934 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.393897 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-podinfo\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.394136 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.393939 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c15c1c8-5094-4411-a6fb-9a489c64e218-istiod-ca-cert\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.394136 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.393986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-token\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.394136 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.394070 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-workload-socket\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.394136 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.394097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-credential-socket\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.394335 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.394228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-workload-certs\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.394335 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.394268 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66b89\" (UniqueName: \"kubernetes.io/projected/1c15c1c8-5094-4411-a6fb-9a489c64e218-kube-api-access-66b89\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.394335 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.394306 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-envoy\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.394501 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.394346 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-data\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.394598 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.394579 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-workload-socket\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.394657 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.394635 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-credential-socket\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.394768 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.394739 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-workload-certs\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.394931 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.394828 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c15c1c8-5094-4411-a6fb-9a489c64e218-istiod-ca-cert\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.394931 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.394854 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-data\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.396621 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.396596 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-envoy\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.396621 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.396609 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-podinfo\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.401762 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.401740 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-token\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.401846 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.401767 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66b89\" (UniqueName: \"kubernetes.io/projected/1c15c1c8-5094-4411-a6fb-9a489c64e218-kube-api-access-66b89\") pod \"e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.416807 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.416778 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:46:31.552740 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.552658 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:31.696113 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.696083 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr"] Jul 29 19:46:31.697961 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:46:31.697934 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c15c1c8_5094_4411_a6fb_9a489c64e218.slice/crio-42c9c6c861d43714ddb744163d3a614b3d50da071b486fbd9671ff90d2a8edf0 WatchSource:0}: Error finding container 42c9c6c861d43714ddb744163d3a614b3d50da071b486fbd9671ff90d2a8edf0: Status 404 returned error can't find the container with id 42c9c6c861d43714ddb744163d3a614b3d50da071b486fbd9671ff90d2a8edf0 Jul 29 19:46:31.700135 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.700104 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:46:31.700205 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.700166 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:46:31.700205 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:31.700193 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:46:32.318248 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:32.318202 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" event={"ID":"1c15c1c8-5094-4411-a6fb-9a489c64e218","Type":"ContainerStarted","Data":"780d4d03c1553ebff890a07cb485a72c678a3f780dcf15768f067b07e49c7da1"} Jul 29 19:46:32.318728 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:32.318269 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" event={"ID":"1c15c1c8-5094-4411-a6fb-9a489c64e218","Type":"ContainerStarted","Data":"42c9c6c861d43714ddb744163d3a614b3d50da071b486fbd9671ff90d2a8edf0"} Jul 29 19:46:32.337295 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:32.337250 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" podStartSLOduration=1.337233839 podStartE2EDuration="1.337233839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:46:32.336100634 +0000 UTC m=+1782.224407862" watchObservedRunningTime="2026-07-29 19:46:32.337233839 +0000 UTC m=+1782.225541065" Jul 29 19:46:32.553251 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:32.553217 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:32.558173 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:32.558150 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:32.734787 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:32.734752 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b91cc4ae-38ac-4cf9-a670-e88247fb2ff2" path="/var/lib/kubelet/pods/b91cc4ae-38ac-4cf9-a670-e88247fb2ff2/volumes" Jul 29 19:46:33.325238 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:33.325208 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:33.326239 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:33.326219 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:33.678337 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:33.678294 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:46:33.778885 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:33.778852 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:46:33.945317 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:33.945231 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:46:34.538311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:34.538278 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:46:34.630328 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:34.630294 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:46:34.986665 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:34.986626 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:46:48.761294 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:48.760871 2574 patch_prober.go:28] interesting pod/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": read tcp 10.132.0.2:60564->10.132.0.59:15021: read: connection reset by peer" start-of-body= Jul 29 19:46:48.761294 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:48.760935 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" podUID="1c15c1c8-5094-4411-a6fb-9a489c64e218" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": read tcp 10.132.0.2:60564->10.132.0.59:15021: read: connection reset by peer" Jul 29 19:46:49.426773 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:49.426735 2574 generic.go:356] "Generic (PLEG): container finished" podID="1c15c1c8-5094-4411-a6fb-9a489c64e218" containerID="780d4d03c1553ebff890a07cb485a72c678a3f780dcf15768f067b07e49c7da1" exitCode=0 Jul 29 19:46:49.426950 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:49.426810 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" event={"ID":"1c15c1c8-5094-4411-a6fb-9a489c64e218","Type":"ContainerDied","Data":"780d4d03c1553ebff890a07cb485a72c678a3f780dcf15768f067b07e49c7da1"} Jul 29 19:46:49.427216 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:49.427202 2574 scope.go:117] "RemoveContainer" containerID="780d4d03c1553ebff890a07cb485a72c678a3f780dcf15768f067b07e49c7da1" Jul 29 19:46:49.428220 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:49.428189 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:46:49.428333 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:49.428276 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:46:49.428396 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:49.428328 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:46:50.434335 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:50.434302 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" event={"ID":"1c15c1c8-5094-4411-a6fb-9a489c64e218","Type":"ContainerStarted","Data":"ae9b472502a0d2c767df7c109b2ca19665def787f86000e388973b563418a278"} Jul 29 19:46:50.553832 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:50.553794 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:50.554009 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:50.553969 2574 patch_prober.go:28] interesting pod/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 29 19:46:50.554057 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:50.554024 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" podUID="1c15c1c8-5094-4411-a6fb-9a489c64e218" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 29 19:46:50.713760 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:50.713672 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:46:50.715445 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:50.715421 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:46:50.719090 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:50.719071 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:46:50.720716 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:50.720700 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:46:51.553766 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:51.553730 2574 patch_prober.go:28] interesting pod/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 29 19:46:51.554140 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:51.553780 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" podUID="1c15c1c8-5094-4411-a6fb-9a489c64e218" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 29 19:46:52.553983 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:52.553945 2574 patch_prober.go:28] interesting pod/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 29 19:46:52.554405 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:52.554010 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" podUID="1c15c1c8-5094-4411-a6fb-9a489c64e218" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 29 19:46:53.553980 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:53.553941 2574 patch_prober.go:28] interesting pod/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 29 19:46:53.554171 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:53.554000 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" podUID="1c15c1c8-5094-4411-a6fb-9a489c64e218" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 29 19:46:54.556873 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:54.556838 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:54.557270 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:54.557229 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:46:54.557977 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:46:54.557955 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:47:04.359706 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:04.359672 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:04.437875 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:04.437845 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:04.514496 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:04.514462 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:04.573955 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:04.573919 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:05.604828 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:05.604796 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr"] Jul 29 19:47:05.605316 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:05.605001 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" podUID="1c15c1c8-5094-4411-a6fb-9a489c64e218" containerName="istio-proxy" containerID="cri-o://ae9b472502a0d2c767df7c109b2ca19665def787f86000e388973b563418a278" gracePeriod=30 Jul 29 19:47:05.622746 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:05.622716 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:05.836862 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:05.836820 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:06.034602 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:06.034544 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:06.335361 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:06.335261 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:06.796661 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:06.796620 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:09.132283 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:09.132245 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:09.217407 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:09.217372 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:09.294417 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:09.294383 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:09.394973 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:09.394944 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:09.559277 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:09.559245 2574 patch_prober.go:28] interesting pod/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 29 19:47:09.559435 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:09.559297 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" podUID="1c15c1c8-5094-4411-a6fb-9a489c64e218" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 19:47:09.836086 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:09.835997 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:09.936069 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:09.936029 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:10.866303 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.866246 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:47:10.959193 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.959158 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-podinfo\") pod \"1c15c1c8-5094-4411-a6fb-9a489c64e218\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " Jul 29 19:47:10.959193 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.959196 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66b89\" (UniqueName: \"kubernetes.io/projected/1c15c1c8-5094-4411-a6fb-9a489c64e218-kube-api-access-66b89\") pod \"1c15c1c8-5094-4411-a6fb-9a489c64e218\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " Jul 29 19:47:10.959425 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.959217 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-workload-socket\") pod \"1c15c1c8-5094-4411-a6fb-9a489c64e218\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " Jul 29 19:47:10.959425 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.959244 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-workload-certs\") pod \"1c15c1c8-5094-4411-a6fb-9a489c64e218\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " Jul 29 19:47:10.959425 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.959315 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-data\") pod \"1c15c1c8-5094-4411-a6fb-9a489c64e218\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " Jul 29 19:47:10.959425 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.959341 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-token\") pod \"1c15c1c8-5094-4411-a6fb-9a489c64e218\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " Jul 29 19:47:10.959425 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.959409 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-envoy\") pod \"1c15c1c8-5094-4411-a6fb-9a489c64e218\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " Jul 29 19:47:10.959729 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.959449 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c15c1c8-5094-4411-a6fb-9a489c64e218-istiod-ca-cert\") pod \"1c15c1c8-5094-4411-a6fb-9a489c64e218\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " Jul 29 19:47:10.959729 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.959558 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-credential-socket\") pod \"1c15c1c8-5094-4411-a6fb-9a489c64e218\" (UID: \"1c15c1c8-5094-4411-a6fb-9a489c64e218\") " Jul 29 19:47:10.959729 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.959551 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1c15c1c8-5094-4411-a6fb-9a489c64e218" (UID: "1c15c1c8-5094-4411-a6fb-9a489c64e218"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:47:10.959729 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.959613 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1c15c1c8-5094-4411-a6fb-9a489c64e218" (UID: "1c15c1c8-5094-4411-a6fb-9a489c64e218"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:47:10.959950 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.959832 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:47:10.959950 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.959852 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:47:10.959950 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.959875 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1c15c1c8-5094-4411-a6fb-9a489c64e218" (UID: "1c15c1c8-5094-4411-a6fb-9a489c64e218"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:47:10.959950 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.959930 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c15c1c8-5094-4411-a6fb-9a489c64e218-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1c15c1c8-5094-4411-a6fb-9a489c64e218" (UID: "1c15c1c8-5094-4411-a6fb-9a489c64e218"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 19:47:10.960307 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.960281 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-data" (OuterVolumeSpecName: "istio-data") pod "1c15c1c8-5094-4411-a6fb-9a489c64e218" (UID: "1c15c1c8-5094-4411-a6fb-9a489c64e218"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:47:10.961701 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.961677 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1c15c1c8-5094-4411-a6fb-9a489c64e218" (UID: "1c15c1c8-5094-4411-a6fb-9a489c64e218"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:47:10.961840 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.961811 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c15c1c8-5094-4411-a6fb-9a489c64e218" (UID: "1c15c1c8-5094-4411-a6fb-9a489c64e218"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:47:10.961959 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.961890 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1c15c1c8-5094-4411-a6fb-9a489c64e218" (UID: "1c15c1c8-5094-4411-a6fb-9a489c64e218"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 19:47:10.961959 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:10.961885 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c15c1c8-5094-4411-a6fb-9a489c64e218-kube-api-access-66b89" (OuterVolumeSpecName: "kube-api-access-66b89") pod "1c15c1c8-5094-4411-a6fb-9a489c64e218" (UID: "1c15c1c8-5094-4411-a6fb-9a489c64e218"). InnerVolumeSpecName "kube-api-access-66b89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:47:11.060325 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.060288 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:47:11.060325 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.060318 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:47:11.060325 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.060328 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:47:11.060325 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.060336 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c15c1c8-5094-4411-a6fb-9a489c64e218-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:47:11.060698 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.060344 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c15c1c8-5094-4411-a6fb-9a489c64e218-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:47:11.060698 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.060354 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c15c1c8-5094-4411-a6fb-9a489c64e218-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:47:11.060698 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.060362 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66b89\" (UniqueName: \"kubernetes.io/projected/1c15c1c8-5094-4411-a6fb-9a489c64e218-kube-api-access-66b89\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:47:11.559968 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.559930 2574 generic.go:356] "Generic (PLEG): container finished" podID="1c15c1c8-5094-4411-a6fb-9a489c64e218" containerID="ae9b472502a0d2c767df7c109b2ca19665def787f86000e388973b563418a278" exitCode=0 Jul 29 19:47:11.560150 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.559981 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" Jul 29 19:47:11.560150 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.559988 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" event={"ID":"1c15c1c8-5094-4411-a6fb-9a489c64e218","Type":"ContainerDied","Data":"ae9b472502a0d2c767df7c109b2ca19665def787f86000e388973b563418a278"} Jul 29 19:47:11.560150 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.560040 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr" event={"ID":"1c15c1c8-5094-4411-a6fb-9a489c64e218","Type":"ContainerDied","Data":"42c9c6c861d43714ddb744163d3a614b3d50da071b486fbd9671ff90d2a8edf0"} Jul 29 19:47:11.560150 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.560064 2574 scope.go:117] "RemoveContainer" containerID="ae9b472502a0d2c767df7c109b2ca19665def787f86000e388973b563418a278" Jul 29 19:47:11.569845 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.569825 2574 scope.go:117] "RemoveContainer" containerID="780d4d03c1553ebff890a07cb485a72c678a3f780dcf15768f067b07e49c7da1" Jul 29 19:47:11.578376 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.578352 2574 scope.go:117] "RemoveContainer" containerID="ae9b472502a0d2c767df7c109b2ca19665def787f86000e388973b563418a278" Jul 29 19:47:11.578650 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:47:11.578632 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae9b472502a0d2c767df7c109b2ca19665def787f86000e388973b563418a278\": container with ID starting with ae9b472502a0d2c767df7c109b2ca19665def787f86000e388973b563418a278 not found: ID does not exist" containerID="ae9b472502a0d2c767df7c109b2ca19665def787f86000e388973b563418a278" Jul 29 19:47:11.578708 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.578661 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae9b472502a0d2c767df7c109b2ca19665def787f86000e388973b563418a278"} err="failed to get container status \"ae9b472502a0d2c767df7c109b2ca19665def787f86000e388973b563418a278\": rpc error: code = NotFound desc = could not find container \"ae9b472502a0d2c767df7c109b2ca19665def787f86000e388973b563418a278\": container with ID starting with ae9b472502a0d2c767df7c109b2ca19665def787f86000e388973b563418a278 not found: ID does not exist" Jul 29 19:47:11.578708 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.578678 2574 scope.go:117] "RemoveContainer" containerID="780d4d03c1553ebff890a07cb485a72c678a3f780dcf15768f067b07e49c7da1" Jul 29 19:47:11.578933 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:47:11.578914 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"780d4d03c1553ebff890a07cb485a72c678a3f780dcf15768f067b07e49c7da1\": container with ID starting with 780d4d03c1553ebff890a07cb485a72c678a3f780dcf15768f067b07e49c7da1 not found: ID does not exist" containerID="780d4d03c1553ebff890a07cb485a72c678a3f780dcf15768f067b07e49c7da1" Jul 29 19:47:11.578985 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.578942 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"780d4d03c1553ebff890a07cb485a72c678a3f780dcf15768f067b07e49c7da1"} err="failed to get container status \"780d4d03c1553ebff890a07cb485a72c678a3f780dcf15768f067b07e49c7da1\": rpc error: code = NotFound desc = could not find container \"780d4d03c1553ebff890a07cb485a72c678a3f780dcf15768f067b07e49c7da1\": container with ID starting with 780d4d03c1553ebff890a07cb485a72c678a3f780dcf15768f067b07e49c7da1 not found: ID does not exist" Jul 29 19:47:11.583724 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.583701 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr"] Jul 29 19:47:11.592815 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:11.589668 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2f25c52f-openshift-default-f6784b954-x2brr"] Jul 29 19:47:12.734075 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:12.734036 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c15c1c8-5094-4411-a6fb-9a489c64e218" path="/var/lib/kubelet/pods/1c15c1c8-5094-4411-a6fb-9a489c64e218/volumes" Jul 29 19:47:39.935852 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:39.935818 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:40.035762 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:40.035723 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:40.103552 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:40.103495 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:40.218154 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:40.218066 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:40.271808 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:40.271780 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:40.483419 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:40.483327 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:40.928308 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:40.928273 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:41.019928 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:41.019888 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:41.133478 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:41.133444 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:42.480472 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:42.480442 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:49.541477 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:49.541438 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:49.664406 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:49.664368 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:49.765486 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:49.765449 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:49.857551 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:49.857429 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:55.335213 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:55.335177 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:59.281402 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:59.281357 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:47:59.340456 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:47:59.340421 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:48:21.272986 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:48:21.272900 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:48:28.259184 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:48:28.259143 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:48:28.362097 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:48:28.362065 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:48:28.459497 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:48:28.459456 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:48:44.315047 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:48:44.315015 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:48:50.455087 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:48:50.455050 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:48:50.563900 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:48:50.563849 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:48:50.659572 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:48:50.659496 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:01.198062 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:01.198021 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:01.950181 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:01.950146 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:02.815124 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:02.815086 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:02.914196 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:02.914160 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:09.514063 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:09.514032 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:09.572918 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:09.572866 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:09.669804 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:09.669764 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:09.755258 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:09.755221 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:09.853836 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:09.853742 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:21.217878 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:21.217839 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:21.316045 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:21.316000 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:21.415759 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:21.415727 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:23.081616 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:23.081585 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:30.651734 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:30.651689 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:30.750464 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:30.750414 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:31.324721 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:31.324689 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:37.859614 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:37.859577 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:37.960106 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:37.960066 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:38.093147 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:38.093101 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:38.414616 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:38.414580 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:38.542504 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:38.542464 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:41.609109 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:41.609068 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:41.704762 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:41.704707 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:41.766458 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:41.766422 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:41.984116 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:41.984080 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:42.294094 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:42.294003 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:49:42.389986 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:49:42.389947 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:06.520188 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:06.520146 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:07.134116 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:07.134081 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:07.231785 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:07.231752 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:07.597820 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:07.597726 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:13.377504 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:13.377465 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:14.939561 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:14.939502 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:15.467698 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:15.467662 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:24.341158 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:24.341124 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:24.419878 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:24.419846 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:24.478818 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:24.478786 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:24.579157 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:24.579124 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:24.849225 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:24.849190 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:30.811213 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:30.811177 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:30.875692 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:30.875662 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:31.079065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:31.078969 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:31.298087 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:31.298049 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:31.417495 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:31.417466 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:31.513054 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:31.513018 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:31.622292 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:31.622251 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:38.187702 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:38.187663 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:38.297544 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:38.297490 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:38.399536 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:38.399475 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:38.570117 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:38.570015 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:44.401650 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:44.401613 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:44.460868 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:44.460832 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:51.219491 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:51.219449 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:51.534090 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:51.534001 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:51.667918 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:51.667882 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:54.794492 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:54.794451 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:54.896760 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:54.896723 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:54.993586 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:54.993550 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:55.270245 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:55.270209 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:55.566349 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:55.566251 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:50:55.652503 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:50:55.652470 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:51:13.839428 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:51:13.839349 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:51:19.757850 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:51:19.757811 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:51:38.350751 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:51:38.350715 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:51:50.751536 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:51:50.751490 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:51:50.754005 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:51:50.753409 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:51:50.757020 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:51:50.756998 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:51:50.759132 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:51:50.759117 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:52:14.501870 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:52:14.501830 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:52:14.624101 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:52:14.624061 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:52:14.713352 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:52:14.713304 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:52:14.770102 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:52:14.770011 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:52:17.880254 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:52:17.880216 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:52:22.907122 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:52:22.907086 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:52:47.087499 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:52:47.087403 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:52:59.847788 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:52:59.847753 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:00.046165 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:00.046115 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:05.911824 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:05.911778 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:20.912666 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:20.912623 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:20.972776 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:20.972744 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:21.189712 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:21.189625 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:21.416908 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:21.416873 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:22.474211 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:22.474168 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:22.573499 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:22.573466 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:22.673292 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:22.673256 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:23.386102 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:23.386065 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:23.493563 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:23.493502 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:23.614711 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:23.614675 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:24.972668 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:24.972626 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:31.582712 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:31.582676 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:31.645242 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:31.645207 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:32.232222 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:32.232179 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:38.718872 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:38.718822 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:38.819307 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:38.819275 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:38.918403 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:38.918370 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:49.382806 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:49.382772 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:53:49.710188 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:53:49.710157 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:10.642306 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:10.642268 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:17.024322 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:17.024234 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:17.125357 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:17.125316 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:17.374101 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:17.374007 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:17.677572 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:17.677526 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:18.138151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:18.138122 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:20.820026 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:20.819967 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:20.912395 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:20.912362 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:20.975796 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:20.975764 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:21.218308 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:21.218273 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:21.399573 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:21.399542 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:21.499403 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:21.499317 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:36.350801 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:36.350757 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:45.859839 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:45.859801 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:46.104715 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.104682 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:46.391868 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.391834 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj"] Jul 29 19:54:46.392233 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.392221 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c15c1c8-5094-4411-a6fb-9a489c64e218" containerName="istio-proxy" Jul 29 19:54:46.392288 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.392235 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c15c1c8-5094-4411-a6fb-9a489c64e218" containerName="istio-proxy" Jul 29 19:54:46.392330 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.392310 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c15c1c8-5094-4411-a6fb-9a489c64e218" containerName="istio-proxy" Jul 29 19:54:46.392330 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.392318 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c15c1c8-5094-4411-a6fb-9a489c64e218" containerName="istio-proxy" Jul 29 19:54:46.395801 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.395782 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.397578 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.397559 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-accf7d-openshift-default-dockercfg-45m4g\"" Jul 29 19:54:46.407375 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.407355 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj"] Jul 29 19:54:46.416783 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.416757 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:46.497548 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.497369 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-workload-socket\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.497801 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.497594 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-credential-socket\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.497801 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.497697 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-data\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.497801 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.497729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-token\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.498082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.497815 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djh4v\" (UniqueName: \"kubernetes.io/projected/ea18315e-9136-4aa2-96b9-3200a5f60d30-kube-api-access-djh4v\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.498082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.497903 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-workload-certs\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.498082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.497961 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea18315e-9136-4aa2-96b9-3200a5f60d30-istiod-ca-cert\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.498082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.498008 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-envoy\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.498082 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.498034 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-podinfo\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.598793 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.598764 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djh4v\" (UniqueName: \"kubernetes.io/projected/ea18315e-9136-4aa2-96b9-3200a5f60d30-kube-api-access-djh4v\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.598987 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.598805 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-workload-certs\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.598987 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.598825 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea18315e-9136-4aa2-96b9-3200a5f60d30-istiod-ca-cert\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.598987 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.598848 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-envoy\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.598987 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.598873 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-podinfo\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.598987 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.598915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-workload-socket\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.599269 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.598994 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-credential-socket\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.599269 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.599017 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-data\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.599269 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.599032 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-token\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.599417 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.599291 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-workload-certs\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.599417 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.599399 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-credential-socket\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.599600 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.599580 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-workload-socket\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.599679 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.599657 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea18315e-9136-4aa2-96b9-3200a5f60d30-istiod-ca-cert\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.599679 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.599664 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-data\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.601344 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.601323 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-podinfo\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.601480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.601464 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-envoy\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.605918 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.605900 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-token\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.606106 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.606087 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djh4v\" (UniqueName: \"kubernetes.io/projected/ea18315e-9136-4aa2-96b9-3200a5f60d30-kube-api-access-djh4v\") pod \"e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.707115 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.707025 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:46.850270 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.850239 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj"] Jul 29 19:54:46.851441 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:54:46.851408 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea18315e_9136_4aa2_96b9_3200a5f60d30.slice/crio-f88a55dfc5c1e4f3e877ddfff614dc96b9e40d28281e1ec2da1855a688ce7fb1 WatchSource:0}: Error finding container f88a55dfc5c1e4f3e877ddfff614dc96b9e40d28281e1ec2da1855a688ce7fb1: Status 404 returned error can't find the container with id f88a55dfc5c1e4f3e877ddfff614dc96b9e40d28281e1ec2da1855a688ce7fb1 Jul 29 19:54:46.852295 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.852270 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:46.853842 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.853800 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:54:46.853924 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.853897 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:54:46.853965 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:46.853943 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:54:47.070481 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:47.070381 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" event={"ID":"ea18315e-9136-4aa2-96b9-3200a5f60d30","Type":"ContainerStarted","Data":"ebb8beb408c6c4648907973b0de0a58d1ce63079792185a33984371bb0b64bb7"} Jul 29 19:54:47.070481 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:47.070448 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" event={"ID":"ea18315e-9136-4aa2-96b9-3200a5f60d30","Type":"ContainerStarted","Data":"f88a55dfc5c1e4f3e877ddfff614dc96b9e40d28281e1ec2da1855a688ce7fb1"} Jul 29 19:54:47.091800 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:47.091747 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" podStartSLOduration=1.091727397 podStartE2EDuration="1.091727397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:54:47.090277883 +0000 UTC m=+2276.978585135" watchObservedRunningTime="2026-07-29 19:54:47.091727397 +0000 UTC m=+2276.980034624" Jul 29 19:54:47.707225 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:47.707193 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:47.712086 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:47.712061 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:48.076309 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:48.076210 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:48.077126 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:48.077108 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:54:48.980489 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:48.980443 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:49.075317 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:49.075281 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:49.307821 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:49.307724 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:49.407861 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:49.407827 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:49.812478 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:49.812436 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:54:49.916249 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:54:49.916208 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:55:04.119724 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:04.119677 2574 patch_prober.go:28] interesting pod/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 29 19:55:04.120165 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:04.119768 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" podUID="ea18315e-9136-4aa2-96b9-3200a5f60d30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 29 19:55:05.174421 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:05.174385 2574 generic.go:356] "Generic (PLEG): container finished" podID="ea18315e-9136-4aa2-96b9-3200a5f60d30" containerID="ebb8beb408c6c4648907973b0de0a58d1ce63079792185a33984371bb0b64bb7" exitCode=0 Jul 29 19:55:05.174833 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:05.174460 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" event={"ID":"ea18315e-9136-4aa2-96b9-3200a5f60d30","Type":"ContainerDied","Data":"ebb8beb408c6c4648907973b0de0a58d1ce63079792185a33984371bb0b64bb7"} Jul 29 19:55:05.174884 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:05.174854 2574 scope.go:117] "RemoveContainer" containerID="ebb8beb408c6c4648907973b0de0a58d1ce63079792185a33984371bb0b64bb7" Jul 29 19:55:05.175879 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:05.175851 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:55:05.175941 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:05.175927 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:55:05.175979 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:05.175965 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:55:06.202997 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:06.202959 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" event={"ID":"ea18315e-9136-4aa2-96b9-3200a5f60d30","Type":"ContainerStarted","Data":"4f40e4b04cb81c0115e72f820e2e01578c0f4a05ec2ac409229deffed7d84230"} Jul 29 19:55:06.707765 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:06.707729 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:55:06.707960 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:06.707938 2574 patch_prober.go:28] interesting pod/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 29 19:55:06.708019 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:06.708001 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" podUID="ea18315e-9136-4aa2-96b9-3200a5f60d30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 29 19:55:07.707624 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:07.707585 2574 patch_prober.go:28] interesting pod/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 29 19:55:07.708033 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:07.707645 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" podUID="ea18315e-9136-4aa2-96b9-3200a5f60d30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 29 19:55:08.708159 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:08.708122 2574 patch_prober.go:28] interesting pod/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 29 19:55:08.708599 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:08.708178 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" podUID="ea18315e-9136-4aa2-96b9-3200a5f60d30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 29 19:55:09.707979 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:09.707944 2574 patch_prober.go:28] interesting pod/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 29 19:55:09.708166 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:09.708009 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" podUID="ea18315e-9136-4aa2-96b9-3200a5f60d30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 29 19:55:10.711243 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:10.711212 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:55:10.711742 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:10.711619 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:55:10.712153 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:10.712134 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:55:13.916635 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:13.916598 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:55:24.268225 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:24.268186 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:55:32.241065 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:32.241018 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:55:51.109386 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:55:51.109283 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:56:43.626505 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:43.626460 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:56:44.554373 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:44.554336 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:56:44.662960 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:44.662920 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh"] Jul 29 19:56:44.663570 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:44.663551 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c15c1c8-5094-4411-a6fb-9a489c64e218" containerName="istio-proxy" Jul 29 19:56:44.663675 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:44.663572 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c15c1c8-5094-4411-a6fb-9a489c64e218" containerName="istio-proxy" Jul 29 19:56:44.665865 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:44.665843 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh" Jul 29 19:56:44.668064 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:44.668035 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hq9l2\"" Jul 29 19:56:44.674607 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:44.674573 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh"] Jul 29 19:56:44.773696 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:44.773663 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh\" (UID: \"ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh" Jul 29 19:56:44.874994 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:44.874895 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh\" (UID: \"ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh" Jul 29 19:56:44.875499 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:44.875479 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh\" (UID: \"ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh" Jul 29 19:56:44.978578 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:44.978547 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh" Jul 29 19:56:45.110557 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:45.110532 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh"] Jul 29 19:56:45.112253 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:56:45.112229 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6b7f20_14a1_4c8d_b8d4_51c63a0ed924.slice/crio-1028e0349f620cca89696f93fcb4e57503c56154669464c6a7143e5725298f68 WatchSource:0}: Error finding container 1028e0349f620cca89696f93fcb4e57503c56154669464c6a7143e5725298f68: Status 404 returned error can't find the container with id 1028e0349f620cca89696f93fcb4e57503c56154669464c6a7143e5725298f68 Jul 29 19:56:45.114572 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:45.114552 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 19:56:45.766387 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:45.766344 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh" event={"ID":"ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924","Type":"ContainerStarted","Data":"1028e0349f620cca89696f93fcb4e57503c56154669464c6a7143e5725298f68"} Jul 29 19:56:48.786091 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:48.786055 2574 generic.go:356] "Generic (PLEG): container finished" podID="ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924" containerID="e06f5c6b35c119ed7824062b95b282f1c23a1cd88bc3c1013c41f3eb5a74e13f" exitCode=0 Jul 29 19:56:48.786504 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:48.786147 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh" event={"ID":"ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924","Type":"ContainerDied","Data":"e06f5c6b35c119ed7824062b95b282f1c23a1cd88bc3c1013c41f3eb5a74e13f"} Jul 29 19:56:49.924036 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:49.924009 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh" Jul 29 19:56:50.024990 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:50.024960 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924-maas-api-service-ca\") pod \"ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924\" (UID: \"ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924\") " Jul 29 19:56:50.025275 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:50.025253 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924" (UID: "ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 19:56:50.125811 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:50.125738 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924-maas-api-service-ca\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:56:50.792497 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:50.792459 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:56:50.795202 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:50.795177 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 19:56:50.797847 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:50.797817 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh" Jul 29 19:56:50.797947 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:50.797856 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh" event={"ID":"ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924","Type":"ContainerDied","Data":"1028e0349f620cca89696f93fcb4e57503c56154669464c6a7143e5725298f68"} Jul 29 19:56:50.797947 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:50.797910 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1028e0349f620cca89696f93fcb4e57503c56154669464c6a7143e5725298f68" Jul 29 19:56:50.798530 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:50.798493 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:56:50.801422 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:50.801402 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 19:56:55.115941 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:55.115907 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:56:55.184893 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:55.184856 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:56:55.246629 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:55.246593 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:56:55.293862 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:55.293827 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh"] Jul 29 19:56:55.296300 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:55.296278 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-59d5db-9brnh"] Jul 29 19:56:55.301465 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:55.301441 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:56:55.649090 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:55.649053 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:56:56.734583 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:56:56.734549 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924" path="/var/lib/kubelet/pods/ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924/volumes" Jul 29 19:57:01.864246 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:01.864214 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:01.930701 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:01.930662 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:02.153935 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:02.153900 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:02.350365 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:02.350330 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:12.773223 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:12.773137 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:12.827963 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:12.827905 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:13.022248 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:13.022216 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:13.123033 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:13.122943 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:13.179126 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:13.179090 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:13.525659 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:13.525626 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:19.508615 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:19.508578 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:19.568270 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:19.568228 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:19.754548 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:19.754496 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj"] Jul 29 19:57:19.754787 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:19.754760 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" podUID="ea18315e-9136-4aa2-96b9-3200a5f60d30" containerName="istio-proxy" containerID="cri-o://4f40e4b04cb81c0115e72f820e2e01578c0f4a05ec2ac409229deffed7d84230" gracePeriod=30 Jul 29 19:57:19.774483 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:19.774402 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:19.994185 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:19.994148 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:20.313048 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:20.313011 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:20.618433 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:20.618351 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:20.889028 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:20.888994 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:23.716861 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:23.716825 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:23.816804 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:23.816768 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:23.881032 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:23.880915 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:24.201099 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:24.201064 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:24.401254 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:24.401187 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:24.504281 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:24.504183 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:24.998127 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:24.998102 2574 generic.go:356] "Generic (PLEG): container finished" podID="ea18315e-9136-4aa2-96b9-3200a5f60d30" containerID="4f40e4b04cb81c0115e72f820e2e01578c0f4a05ec2ac409229deffed7d84230" exitCode=0 Jul 29 19:57:24.998461 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:24.998164 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" event={"ID":"ea18315e-9136-4aa2-96b9-3200a5f60d30","Type":"ContainerDied","Data":"4f40e4b04cb81c0115e72f820e2e01578c0f4a05ec2ac409229deffed7d84230"} Jul 29 19:57:24.998461 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:24.998210 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" event={"ID":"ea18315e-9136-4aa2-96b9-3200a5f60d30","Type":"ContainerDied","Data":"f88a55dfc5c1e4f3e877ddfff614dc96b9e40d28281e1ec2da1855a688ce7fb1"} Jul 29 19:57:24.998461 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:24.998230 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f88a55dfc5c1e4f3e877ddfff614dc96b9e40d28281e1ec2da1855a688ce7fb1" Jul 29 19:57:24.998461 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:24.998243 2574 scope.go:117] "RemoveContainer" containerID="ebb8beb408c6c4648907973b0de0a58d1ce63079792185a33984371bb0b64bb7" Jul 29 19:57:25.014888 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.014868 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:57:25.147964 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.147936 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-credential-socket\") pod \"ea18315e-9136-4aa2-96b9-3200a5f60d30\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " Jul 29 19:57:25.148152 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.147985 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-data\") pod \"ea18315e-9136-4aa2-96b9-3200a5f60d30\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " Jul 29 19:57:25.148152 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.148014 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-workload-certs\") pod \"ea18315e-9136-4aa2-96b9-3200a5f60d30\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " Jul 29 19:57:25.148152 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.148046 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-envoy\") pod \"ea18315e-9136-4aa2-96b9-3200a5f60d30\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " Jul 29 19:57:25.148152 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.148126 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djh4v\" (UniqueName: \"kubernetes.io/projected/ea18315e-9136-4aa2-96b9-3200a5f60d30-kube-api-access-djh4v\") pod \"ea18315e-9136-4aa2-96b9-3200a5f60d30\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " Jul 29 19:57:25.148379 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.148159 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-workload-socket\") pod \"ea18315e-9136-4aa2-96b9-3200a5f60d30\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " Jul 29 19:57:25.148379 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.148192 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-token\") pod \"ea18315e-9136-4aa2-96b9-3200a5f60d30\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " Jul 29 19:57:25.148379 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.148219 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-podinfo\") pod \"ea18315e-9136-4aa2-96b9-3200a5f60d30\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " Jul 29 19:57:25.148379 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.148275 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea18315e-9136-4aa2-96b9-3200a5f60d30-istiod-ca-cert\") pod \"ea18315e-9136-4aa2-96b9-3200a5f60d30\" (UID: \"ea18315e-9136-4aa2-96b9-3200a5f60d30\") " Jul 29 19:57:25.148379 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.148257 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea18315e-9136-4aa2-96b9-3200a5f60d30" (UID: "ea18315e-9136-4aa2-96b9-3200a5f60d30"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:57:25.148686 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.148460 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea18315e-9136-4aa2-96b9-3200a5f60d30" (UID: "ea18315e-9136-4aa2-96b9-3200a5f60d30"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:57:25.148686 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.148625 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:57:25.148686 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.148644 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:57:25.148987 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.148752 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea18315e-9136-4aa2-96b9-3200a5f60d30" (UID: "ea18315e-9136-4aa2-96b9-3200a5f60d30"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:57:25.148987 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.148804 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea18315e-9136-4aa2-96b9-3200a5f60d30-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea18315e-9136-4aa2-96b9-3200a5f60d30" (UID: "ea18315e-9136-4aa2-96b9-3200a5f60d30"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 19:57:25.149104 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.149010 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea18315e-9136-4aa2-96b9-3200a5f60d30" (UID: "ea18315e-9136-4aa2-96b9-3200a5f60d30"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:57:25.150553 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.150525 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea18315e-9136-4aa2-96b9-3200a5f60d30" (UID: "ea18315e-9136-4aa2-96b9-3200a5f60d30"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 19:57:25.150663 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.150644 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea18315e-9136-4aa2-96b9-3200a5f60d30" (UID: "ea18315e-9136-4aa2-96b9-3200a5f60d30"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:57:25.150908 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.150880 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea18315e-9136-4aa2-96b9-3200a5f60d30" (UID: "ea18315e-9136-4aa2-96b9-3200a5f60d30"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:57:25.150997 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.150886 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea18315e-9136-4aa2-96b9-3200a5f60d30-kube-api-access-djh4v" (OuterVolumeSpecName: "kube-api-access-djh4v") pod "ea18315e-9136-4aa2-96b9-3200a5f60d30" (UID: "ea18315e-9136-4aa2-96b9-3200a5f60d30"). InnerVolumeSpecName "kube-api-access-djh4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:57:25.249594 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.249554 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:57:25.249594 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.249592 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djh4v\" (UniqueName: \"kubernetes.io/projected/ea18315e-9136-4aa2-96b9-3200a5f60d30-kube-api-access-djh4v\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:57:25.249594 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.249602 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:57:25.249594 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.249612 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:57:25.249855 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.249620 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea18315e-9136-4aa2-96b9-3200a5f60d30-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:57:25.249855 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.249628 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:57:25.249855 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:25.249635 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea18315e-9136-4aa2-96b9-3200a5f60d30-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:57:26.004729 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:26.004697 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj" Jul 29 19:57:26.037218 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:26.037185 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj"] Jul 29 19:57:26.041100 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:26.041077 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-accf7d-openshift-default-5f7bbbf7d4-bzzzj"] Jul 29 19:57:26.734335 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:26.734301 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea18315e-9136-4aa2-96b9-3200a5f60d30" path="/var/lib/kubelet/pods/ea18315e-9136-4aa2-96b9-3200a5f60d30/volumes" Jul 29 19:57:48.699354 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:48.699318 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:49.157942 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.157908 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:49.448112 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.448036 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x"] Jul 29 19:57:49.448652 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.448636 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea18315e-9136-4aa2-96b9-3200a5f60d30" containerName="istio-proxy" Jul 29 19:57:49.448705 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.448656 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea18315e-9136-4aa2-96b9-3200a5f60d30" containerName="istio-proxy" Jul 29 19:57:49.448705 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.448682 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924" containerName="revoke-keys" Jul 29 19:57:49.448705 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.448691 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924" containerName="revoke-keys" Jul 29 19:57:49.448705 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.448703 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea18315e-9136-4aa2-96b9-3200a5f60d30" containerName="istio-proxy" Jul 29 19:57:49.448910 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.448711 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea18315e-9136-4aa2-96b9-3200a5f60d30" containerName="istio-proxy" Jul 29 19:57:49.448910 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.448796 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea18315e-9136-4aa2-96b9-3200a5f60d30" containerName="istio-proxy" Jul 29 19:57:49.448910 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.448809 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6b7f20-14a1-4c8d-b8d4-51c63a0ed924" containerName="revoke-keys" Jul 29 19:57:49.452380 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.452358 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.454298 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.454276 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-0e0fe5-openshift-default-dockercfg-75wzs\"" Jul 29 19:57:49.464460 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.464434 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x"] Jul 29 19:57:49.480773 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.480744 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:49.564035 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.563984 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-credential-socket\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.564264 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.564052 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-data\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.564264 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.564088 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-token\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.564264 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.564122 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-envoy\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.564264 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.564146 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-podinfo\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.564264 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.564180 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-589mx\" (UniqueName: \"kubernetes.io/projected/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-kube-api-access-589mx\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.564264 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.564223 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istiod-ca-cert\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.564668 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.564288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-workload-certs\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.564668 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.564319 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-workload-socket\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.665206 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.665176 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-data\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.665378 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.665211 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-token\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.665378 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.665235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-envoy\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.665378 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.665250 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-podinfo\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.665378 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.665271 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-589mx\" (UniqueName: \"kubernetes.io/projected/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-kube-api-access-589mx\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.665378 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.665303 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istiod-ca-cert\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.665378 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.665360 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-workload-certs\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.665754 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.665388 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-workload-socket\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.665754 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.665429 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-credential-socket\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.665754 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.665629 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-data\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.665921 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.665772 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-workload-certs\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.665921 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.665835 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-credential-socket\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.665921 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.665892 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-workload-socket\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.666236 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.666217 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istiod-ca-cert\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.667644 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.667623 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-envoy\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.667869 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.667851 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-podinfo\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.672713 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.672693 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-token\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.672790 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.672777 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-589mx\" (UniqueName: \"kubernetes.io/projected/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-kube-api-access-589mx\") pod \"e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.766370 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.766258 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:49.918617 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.918593 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x"] Jul 29 19:57:49.920901 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:57:49.920855 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc41b268_f2ea_4546_9dde_04cb38ffb4c4.slice/crio-34e013bd3656a1cd40d7c5c07a6180ba4feb7ecc71b6bba91a5079f86040243f WatchSource:0}: Error finding container 34e013bd3656a1cd40d7c5c07a6180ba4feb7ecc71b6bba91a5079f86040243f: Status 404 returned error can't find the container with id 34e013bd3656a1cd40d7c5c07a6180ba4feb7ecc71b6bba91a5079f86040243f Jul 29 19:57:49.923432 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.923387 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:57:49.923561 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.923486 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:57:49.923561 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:49.923547 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:57:50.145608 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:50.145569 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" event={"ID":"bc41b268-f2ea-4546-9dde-04cb38ffb4c4","Type":"ContainerStarted","Data":"e1ba99106007ca07b2a1719d229f74d724331cb89472f57e9ec7c6a74aa599c5"} Jul 29 19:57:50.145823 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:50.145636 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" event={"ID":"bc41b268-f2ea-4546-9dde-04cb38ffb4c4","Type":"ContainerStarted","Data":"34e013bd3656a1cd40d7c5c07a6180ba4feb7ecc71b6bba91a5079f86040243f"} Jul 29 19:57:50.167198 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:50.167141 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" podStartSLOduration=1.16712126 podStartE2EDuration="1.16712126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:57:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:57:50.16371893 +0000 UTC m=+2460.052026159" watchObservedRunningTime="2026-07-29 19:57:50.16712126 +0000 UTC m=+2460.055428488" Jul 29 19:57:50.220009 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:50.219961 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:50.767466 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:50.767437 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:50.773618 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:50.773590 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:51.151634 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:51.151606 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:51.152618 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:51.152597 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:57:52.064952 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:52.064916 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:52.165224 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:52.165188 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:52.338980 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:52.338894 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:52.483671 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:52.483631 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:52.862033 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:52.861999 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:57:52.959807 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:57:52.959764 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:58:07.153171 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:07.153131 2574 patch_prober.go:28] interesting pod/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 29 19:58:07.153795 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:07.153194 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" podUID="bc41b268-f2ea-4546-9dde-04cb38ffb4c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 29 19:58:09.257214 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:09.257179 2574 generic.go:356] "Generic (PLEG): container finished" podID="bc41b268-f2ea-4546-9dde-04cb38ffb4c4" containerID="e1ba99106007ca07b2a1719d229f74d724331cb89472f57e9ec7c6a74aa599c5" exitCode=0 Jul 29 19:58:09.257679 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:09.257245 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" event={"ID":"bc41b268-f2ea-4546-9dde-04cb38ffb4c4","Type":"ContainerDied","Data":"e1ba99106007ca07b2a1719d229f74d724331cb89472f57e9ec7c6a74aa599c5"} Jul 29 19:58:09.257736 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:09.257692 2574 scope.go:117] "RemoveContainer" containerID="e1ba99106007ca07b2a1719d229f74d724331cb89472f57e9ec7c6a74aa599c5" Jul 29 19:58:09.258890 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:09.258859 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:58:09.258992 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:09.258927 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:58:09.258992 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:09.258958 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:58:10.264958 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:10.264920 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" event={"ID":"bc41b268-f2ea-4546-9dde-04cb38ffb4c4","Type":"ContainerStarted","Data":"8304435dd56fac1e87f6636ebe956920ebfdc2550c11493e6ac8b596879850b3"} Jul 29 19:58:10.767232 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:10.767201 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:58:10.767403 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:10.767372 2574 patch_prober.go:28] interesting pod/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 29 19:58:10.767454 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:10.767415 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" podUID="bc41b268-f2ea-4546-9dde-04cb38ffb4c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 29 19:58:11.766778 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:11.766739 2574 patch_prober.go:28] interesting pod/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 29 19:58:11.767168 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:11.766804 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" podUID="bc41b268-f2ea-4546-9dde-04cb38ffb4c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 29 19:58:12.766854 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:12.766824 2574 patch_prober.go:28] interesting pod/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 29 19:58:12.767253 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:12.766878 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" podUID="bc41b268-f2ea-4546-9dde-04cb38ffb4c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 29 19:58:13.766794 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:13.766755 2574 patch_prober.go:28] interesting pod/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 29 19:58:13.766998 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:13.766812 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" podUID="bc41b268-f2ea-4546-9dde-04cb38ffb4c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 29 19:58:14.770631 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:14.770593 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:58:14.771032 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:14.770965 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:58:14.771704 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:14.771684 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:58:17.004291 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:17.004256 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:58:35.273443 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:35.273406 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:58:35.343610 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:35.343574 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:58:35.407349 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:35.407313 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:58:35.508480 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:35.508442 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:58:35.831113 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:35.831062 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:58:42.224433 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:42.224401 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:58:42.284412 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:42.284382 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:58:42.475659 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:42.475545 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:58:42.699354 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:42.699277 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:58:55.420206 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:55.420169 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:58:58.236794 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:58.236758 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:58:58.309013 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:58.308978 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:58:58.372559 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:58.372491 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:58:58.474413 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:58.474375 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:58:58.774525 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:58:58.774482 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:04.886144 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:04.886103 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:04.950222 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:04.950180 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:05.131012 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:05.130977 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x"] Jul 29 19:59:05.131254 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:05.131229 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" podUID="bc41b268-f2ea-4546-9dde-04cb38ffb4c4" containerName="istio-proxy" containerID="cri-o://8304435dd56fac1e87f6636ebe956920ebfdc2550c11493e6ac8b596879850b3" gracePeriod=30 Jul 29 19:59:05.144886 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:05.144817 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:05.365940 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:05.365893 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:05.690434 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:05.690391 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:05.992322 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:05.992240 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:06.164478 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:06.164444 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:09.262359 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:09.262320 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:09.358929 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:09.358893 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:09.459683 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:09.459645 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:09.838415 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:09.838358 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:09.942259 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:09.942224 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:10.037151 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.037120 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:10.389522 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.389485 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:59:10.508910 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.508829 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-data\") pod \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " Jul 29 19:59:10.508910 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.508869 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-token\") pod \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " Jul 29 19:59:10.508910 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.508886 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-credential-socket\") pod \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " Jul 29 19:59:10.509215 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.508921 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-workload-socket\") pod \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " Jul 29 19:59:10.509215 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.509020 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-589mx\" (UniqueName: \"kubernetes.io/projected/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-kube-api-access-589mx\") pod \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " Jul 29 19:59:10.509215 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.509053 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-workload-certs\") pod \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " Jul 29 19:59:10.509215 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.509079 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-envoy\") pod \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " Jul 29 19:59:10.509215 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.509191 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc41b268-f2ea-4546-9dde-04cb38ffb4c4" (UID: "bc41b268-f2ea-4546-9dde-04cb38ffb4c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:59:10.509490 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.509226 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc41b268-f2ea-4546-9dde-04cb38ffb4c4" (UID: "bc41b268-f2ea-4546-9dde-04cb38ffb4c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:59:10.509490 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.509241 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-podinfo\") pod \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " Jul 29 19:59:10.509490 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.509270 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istiod-ca-cert\") pod \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\" (UID: \"bc41b268-f2ea-4546-9dde-04cb38ffb4c4\") " Jul 29 19:59:10.509490 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.509446 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc41b268-f2ea-4546-9dde-04cb38ffb4c4" (UID: "bc41b268-f2ea-4546-9dde-04cb38ffb4c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:59:10.509831 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.509695 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:59:10.509831 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.509718 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:59:10.509831 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.509734 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:59:10.509831 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.509762 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc41b268-f2ea-4546-9dde-04cb38ffb4c4" (UID: "bc41b268-f2ea-4546-9dde-04cb38ffb4c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:59:10.510007 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.509822 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc41b268-f2ea-4546-9dde-04cb38ffb4c4" (UID: "bc41b268-f2ea-4546-9dde-04cb38ffb4c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 19:59:10.511252 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.511223 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc41b268-f2ea-4546-9dde-04cb38ffb4c4" (UID: "bc41b268-f2ea-4546-9dde-04cb38ffb4c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 19:59:10.511359 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.511262 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-kube-api-access-589mx" (OuterVolumeSpecName: "kube-api-access-589mx") pod "bc41b268-f2ea-4546-9dde-04cb38ffb4c4" (UID: "bc41b268-f2ea-4546-9dde-04cb38ffb4c4"). InnerVolumeSpecName "kube-api-access-589mx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:59:10.511532 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.511489 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc41b268-f2ea-4546-9dde-04cb38ffb4c4" (UID: "bc41b268-f2ea-4546-9dde-04cb38ffb4c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 19:59:10.511532 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.511499 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc41b268-f2ea-4546-9dde-04cb38ffb4c4" (UID: "bc41b268-f2ea-4546-9dde-04cb38ffb4c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 19:59:10.610706 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.610667 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-589mx\" (UniqueName: \"kubernetes.io/projected/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-kube-api-access-589mx\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:59:10.610706 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.610703 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:59:10.610706 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.610713 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:59:10.610706 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.610720 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:59:10.610959 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.610729 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:59:10.610959 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.610736 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc41b268-f2ea-4546-9dde-04cb38ffb4c4-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 19:59:10.635389 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.635354 2574 generic.go:356] "Generic (PLEG): container finished" podID="bc41b268-f2ea-4546-9dde-04cb38ffb4c4" containerID="8304435dd56fac1e87f6636ebe956920ebfdc2550c11493e6ac8b596879850b3" exitCode=0 Jul 29 19:59:10.635605 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.635586 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" event={"ID":"bc41b268-f2ea-4546-9dde-04cb38ffb4c4","Type":"ContainerDied","Data":"8304435dd56fac1e87f6636ebe956920ebfdc2550c11493e6ac8b596879850b3"} Jul 29 19:59:10.635694 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.635619 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" Jul 29 19:59:10.635694 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.635674 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x" event={"ID":"bc41b268-f2ea-4546-9dde-04cb38ffb4c4","Type":"ContainerDied","Data":"34e013bd3656a1cd40d7c5c07a6180ba4feb7ecc71b6bba91a5079f86040243f"} Jul 29 19:59:10.635801 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.635709 2574 scope.go:117] "RemoveContainer" containerID="8304435dd56fac1e87f6636ebe956920ebfdc2550c11493e6ac8b596879850b3" Jul 29 19:59:10.645223 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.645205 2574 scope.go:117] "RemoveContainer" containerID="e1ba99106007ca07b2a1719d229f74d724331cb89472f57e9ec7c6a74aa599c5" Jul 29 19:59:10.653111 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.653095 2574 scope.go:117] "RemoveContainer" containerID="8304435dd56fac1e87f6636ebe956920ebfdc2550c11493e6ac8b596879850b3" Jul 29 19:59:10.653358 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:59:10.653333 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8304435dd56fac1e87f6636ebe956920ebfdc2550c11493e6ac8b596879850b3\": container with ID starting with 8304435dd56fac1e87f6636ebe956920ebfdc2550c11493e6ac8b596879850b3 not found: ID does not exist" containerID="8304435dd56fac1e87f6636ebe956920ebfdc2550c11493e6ac8b596879850b3" Jul 29 19:59:10.653423 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.653365 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8304435dd56fac1e87f6636ebe956920ebfdc2550c11493e6ac8b596879850b3"} err="failed to get container status \"8304435dd56fac1e87f6636ebe956920ebfdc2550c11493e6ac8b596879850b3\": rpc error: code = NotFound desc = could not find container \"8304435dd56fac1e87f6636ebe956920ebfdc2550c11493e6ac8b596879850b3\": container with ID starting with 8304435dd56fac1e87f6636ebe956920ebfdc2550c11493e6ac8b596879850b3 not found: ID does not exist" Jul 29 19:59:10.653423 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.653387 2574 scope.go:117] "RemoveContainer" containerID="e1ba99106007ca07b2a1719d229f74d724331cb89472f57e9ec7c6a74aa599c5" Jul 29 19:59:10.653645 ip-10-0-136-162 kubenswrapper[2574]: E0729 19:59:10.653629 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1ba99106007ca07b2a1719d229f74d724331cb89472f57e9ec7c6a74aa599c5\": container with ID starting with e1ba99106007ca07b2a1719d229f74d724331cb89472f57e9ec7c6a74aa599c5 not found: ID does not exist" containerID="e1ba99106007ca07b2a1719d229f74d724331cb89472f57e9ec7c6a74aa599c5" Jul 29 19:59:10.653702 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.653649 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1ba99106007ca07b2a1719d229f74d724331cb89472f57e9ec7c6a74aa599c5"} err="failed to get container status \"e1ba99106007ca07b2a1719d229f74d724331cb89472f57e9ec7c6a74aa599c5\": rpc error: code = NotFound desc = could not find container \"e1ba99106007ca07b2a1719d229f74d724331cb89472f57e9ec7c6a74aa599c5\": container with ID starting with e1ba99106007ca07b2a1719d229f74d724331cb89472f57e9ec7c6a74aa599c5 not found: ID does not exist" Jul 29 19:59:10.658053 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.658031 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x"] Jul 29 19:59:10.660280 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.660257 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-0e0fe5-openshift-default-67bb5b7444-mvz8x"] Jul 29 19:59:10.734304 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:10.734271 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc41b268-f2ea-4546-9dde-04cb38ffb4c4" path="/var/lib/kubelet/pods/bc41b268-f2ea-4546-9dde-04cb38ffb4c4/volumes" Jul 29 19:59:34.248997 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.248962 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:34.567461 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.567363 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:34.838408 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.838336 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2"] Jul 29 19:59:34.839048 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.839025 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc41b268-f2ea-4546-9dde-04cb38ffb4c4" containerName="istio-proxy" Jul 29 19:59:34.839105 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.839053 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc41b268-f2ea-4546-9dde-04cb38ffb4c4" containerName="istio-proxy" Jul 29 19:59:34.839105 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.839073 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc41b268-f2ea-4546-9dde-04cb38ffb4c4" containerName="istio-proxy" Jul 29 19:59:34.839105 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.839082 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc41b268-f2ea-4546-9dde-04cb38ffb4c4" containerName="istio-proxy" Jul 29 19:59:34.839226 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.839212 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea18315e-9136-4aa2-96b9-3200a5f60d30" containerName="istio-proxy" Jul 29 19:59:34.839261 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.839236 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc41b268-f2ea-4546-9dde-04cb38ffb4c4" containerName="istio-proxy" Jul 29 19:59:34.839261 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.839250 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc41b268-f2ea-4546-9dde-04cb38ffb4c4" containerName="istio-proxy" Jul 29 19:59:34.842889 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.842871 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:34.844831 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.844799 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-601aa9-openshift-default-dockercfg-v5zpd\"" Jul 29 19:59:34.854107 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.854085 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2"] Jul 29 19:59:34.864012 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.863971 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:34.925556 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.925505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-token\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:34.925695 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.925566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-workload-socket\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:34.925695 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.925630 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-podinfo\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:34.925695 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.925685 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m8q9\" (UniqueName: \"kubernetes.io/projected/6efb1ae9-826e-4241-875d-4aebc9400d63-kube-api-access-5m8q9\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:34.925841 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.925726 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6efb1ae9-826e-4241-875d-4aebc9400d63-istiod-ca-cert\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:34.925841 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.925801 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-credential-socket\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:34.925841 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.925830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-data\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:34.925961 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.925897 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-workload-certs\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:34.925961 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:34.925914 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-envoy\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.027311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.027270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-token\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.027311 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.027314 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-workload-socket\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.027622 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.027344 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-podinfo\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.027622 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.027374 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8q9\" (UniqueName: \"kubernetes.io/projected/6efb1ae9-826e-4241-875d-4aebc9400d63-kube-api-access-5m8q9\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.027622 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.027412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6efb1ae9-826e-4241-875d-4aebc9400d63-istiod-ca-cert\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.027622 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.027452 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-credential-socket\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.027622 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.027483 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-data\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.027622 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.027585 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-workload-certs\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.027622 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.027612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-envoy\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.027999 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.027778 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-workload-socket\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.027999 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.027919 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-data\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.028083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.028004 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-workload-certs\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.028083 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.028041 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-credential-socket\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.028314 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.028256 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6efb1ae9-826e-4241-875d-4aebc9400d63-istiod-ca-cert\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.029896 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.029874 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-envoy\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.030045 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.030026 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-podinfo\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.034977 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.034947 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-token\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.035090 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.035074 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m8q9\" (UniqueName: \"kubernetes.io/projected/6efb1ae9-826e-4241-875d-4aebc9400d63-kube-api-access-5m8q9\") pod \"e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.155862 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.155829 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:35.284936 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.284902 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:35.298055 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.298006 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2"] Jul 29 19:59:35.300410 ip-10-0-136-162 kubenswrapper[2574]: W0729 19:59:35.300385 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6efb1ae9_826e_4241_875d_4aebc9400d63.slice/crio-7dc4df47960061bdecde385d629b5c7424e3ce35e687121937027bdf9dd65e6e WatchSource:0}: Error finding container 7dc4df47960061bdecde385d629b5c7424e3ce35e687121937027bdf9dd65e6e: Status 404 returned error can't find the container with id 7dc4df47960061bdecde385d629b5c7424e3ce35e687121937027bdf9dd65e6e Jul 29 19:59:35.302742 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.302711 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:59:35.302821 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.302794 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:59:35.302859 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.302823 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:59:35.779270 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.779230 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" event={"ID":"6efb1ae9-826e-4241-875d-4aebc9400d63","Type":"ContainerStarted","Data":"5acd8622a8df68bafb8f4c4e3b18699c2dc46cc32dc430611216d2d3d3ef75d2"} Jul 29 19:59:35.779477 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.779285 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" event={"ID":"6efb1ae9-826e-4241-875d-4aebc9400d63","Type":"ContainerStarted","Data":"7dc4df47960061bdecde385d629b5c7424e3ce35e687121937027bdf9dd65e6e"} Jul 29 19:59:35.800148 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:35.800087 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" podStartSLOduration=1.800069588 podStartE2EDuration="1.800069588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 19:59:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 19:59:35.799164756 +0000 UTC m=+2565.687471984" watchObservedRunningTime="2026-07-29 19:59:35.800069588 +0000 UTC m=+2565.688376815" Jul 29 19:59:36.156978 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:36.156939 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:36.161858 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:36.161833 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:36.784575 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:36.784543 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:36.785571 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:36.785553 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:37.683464 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:37.683432 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:37.778877 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:37.778841 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:37.968574 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:37.968484 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:38.089734 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:38.089697 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:38.503196 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:38.503163 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:38.580144 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:38.580109 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 19:59:52.826712 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:52.826667 2574 patch_prober.go:28] interesting pod/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 29 19:59:52.827139 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:52.826741 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" podUID="6efb1ae9-826e-4241-875d-4aebc9400d63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 29 19:59:53.887554 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:53.887504 2574 generic.go:356] "Generic (PLEG): container finished" podID="6efb1ae9-826e-4241-875d-4aebc9400d63" containerID="5acd8622a8df68bafb8f4c4e3b18699c2dc46cc32dc430611216d2d3d3ef75d2" exitCode=0 Jul 29 19:59:53.887554 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:53.887539 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" event={"ID":"6efb1ae9-826e-4241-875d-4aebc9400d63","Type":"ContainerDied","Data":"5acd8622a8df68bafb8f4c4e3b18699c2dc46cc32dc430611216d2d3d3ef75d2"} Jul 29 19:59:53.888010 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:53.887937 2574 scope.go:117] "RemoveContainer" containerID="5acd8622a8df68bafb8f4c4e3b18699c2dc46cc32dc430611216d2d3d3ef75d2" Jul 29 19:59:53.888979 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:53.888949 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:59:53.889069 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:53.889038 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:59:53.889132 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:53.889085 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 19:59:54.898247 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:54.898207 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" event={"ID":"6efb1ae9-826e-4241-875d-4aebc9400d63","Type":"ContainerStarted","Data":"9f1c4f7be86d20ee20de790d35b87b5638219f2726c3c75d719a1dd2a4ccf787"} Jul 29 19:59:55.157062 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:55.156977 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:55.157259 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:55.157237 2574 patch_prober.go:28] interesting pod/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 29 19:59:55.157304 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:55.157286 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" podUID="6efb1ae9-826e-4241-875d-4aebc9400d63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 29 19:59:56.156522 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:56.156483 2574 patch_prober.go:28] interesting pod/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 29 19:59:56.156923 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:56.156558 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" podUID="6efb1ae9-826e-4241-875d-4aebc9400d63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 29 19:59:57.156180 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:57.156145 2574 patch_prober.go:28] interesting pod/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 29 19:59:57.156368 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:57.156197 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" podUID="6efb1ae9-826e-4241-875d-4aebc9400d63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 29 19:59:58.156824 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:58.156788 2574 patch_prober.go:28] interesting pod/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 29 19:59:58.157230 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:58.156848 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" podUID="6efb1ae9-826e-4241-875d-4aebc9400d63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 29 19:59:59.159849 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:59.159816 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:59.160297 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:59.160268 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 19:59:59.160808 ip-10-0-136-162 kubenswrapper[2574]: I0729 19:59:59.160791 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 20:00:02.928086 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:00:02.928046 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:00:18.578705 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:00:18.578619 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:00:48.860770 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:00:48.860726 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:01:05.188381 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:01:05.188338 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:01:15.334975 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:01:15.334941 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:01:50.834239 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:01:50.833987 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 20:01:50.840123 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:01:50.840101 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 20:01:50.840588 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:01:50.840567 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 20:01:50.845738 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:01:50.845716 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 20:01:50.935433 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:01:50.935401 2574 scope.go:117] "RemoveContainer" containerID="4f40e4b04cb81c0115e72f820e2e01578c0f4a05ec2ac409229deffed7d84230" Jul 29 20:02:26.681606 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:02:26.681563 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:02:50.957888 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:02:50.957855 2574 scope.go:117] "RemoveContainer" containerID="e06f5c6b35c119ed7824062b95b282f1c23a1cd88bc3c1013c41f3eb5a74e13f" Jul 29 20:03:04.275591 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:03:04.275554 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:03:04.328246 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:03:04.328202 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:05:19.544001 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:05:19.543951 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:05:20.508562 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:05:20.508432 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:05:35.598691 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:05:35.598647 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:06:13.351434 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:06:13.351309 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:06:50.880466 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:06:50.880437 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 20:06:50.885972 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:06:50.885953 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 20:06:50.886102 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:06:50.885975 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 20:06:50.891548 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:06:50.891532 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 20:07:04.700978 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:07:04.700946 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:07:19.656807 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:07:19.656772 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:07:20.557143 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:07:20.557109 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:07:40.260909 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:07:40.260877 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:07:59.163105 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:07:59.163074 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:08:36.776647 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:08:36.776613 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:08:36.825979 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:08:36.825931 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:09:08.963241 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:08.963205 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:09:13.119953 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:13.119859 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pgsgl"] Jul 29 20:09:13.123586 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:13.123563 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" Jul 29 20:09:13.132952 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:13.132925 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pgsgl"] Jul 29 20:09:13.262596 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:13.262553 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g49p8\" (UniqueName: \"kubernetes.io/projected/1e17fad5-d1af-457a-8464-e297c82f0685-kube-api-access-g49p8\") pod \"kuadrant-operator-catalog-pgsgl\" (UID: \"1e17fad5-d1af-457a-8464-e297c82f0685\") " pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" Jul 29 20:09:13.363505 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:13.363469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g49p8\" (UniqueName: \"kubernetes.io/projected/1e17fad5-d1af-457a-8464-e297c82f0685-kube-api-access-g49p8\") pod \"kuadrant-operator-catalog-pgsgl\" (UID: \"1e17fad5-d1af-457a-8464-e297c82f0685\") " pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" Jul 29 20:09:13.372197 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:13.372126 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g49p8\" (UniqueName: \"kubernetes.io/projected/1e17fad5-d1af-457a-8464-e297c82f0685-kube-api-access-g49p8\") pod \"kuadrant-operator-catalog-pgsgl\" (UID: \"1e17fad5-d1af-457a-8464-e297c82f0685\") " pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" Jul 29 20:09:13.435227 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:13.435204 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" Jul 29 20:09:13.570725 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:13.570696 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pgsgl"] Jul 29 20:09:13.571922 ip-10-0-136-162 kubenswrapper[2574]: W0729 20:09:13.571897 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e17fad5_d1af_457a_8464_e297c82f0685.slice/crio-d66b1754bce6ad5ef52b0aded43d114232b0ddc30ab45867b8e441c6f979492c WatchSource:0}: Error finding container d66b1754bce6ad5ef52b0aded43d114232b0ddc30ab45867b8e441c6f979492c: Status 404 returned error can't find the container with id d66b1754bce6ad5ef52b0aded43d114232b0ddc30ab45867b8e441c6f979492c Jul 29 20:09:13.573252 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:13.573233 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 20:09:14.034703 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:14.034671 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" event={"ID":"1e17fad5-d1af-457a-8464-e297c82f0685","Type":"ContainerStarted","Data":"d66b1754bce6ad5ef52b0aded43d114232b0ddc30ab45867b8e441c6f979492c"} Jul 29 20:09:15.041602 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:15.041554 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" event={"ID":"1e17fad5-d1af-457a-8464-e297c82f0685","Type":"ContainerStarted","Data":"a9c5ed2c6917a1899890448ec927db27982e9be961319ddd239ca9111ca7e676"} Jul 29 20:09:15.055674 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:15.055617 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" podStartSLOduration=1.30205811 podStartE2EDuration="2.055597977s" totalImagesPullingTime="753.539867ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:09:15.055168447 +0000 UTC m=+3144.943475699" watchObservedRunningTime="2026-07-29 20:09:15.055597977 +0000 UTC m=+3144.943905203" Jul 29 20:09:16.801379 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:16.801330 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:09:17.571295 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:17.571260 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:09:18.830220 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:18.830183 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7535-140196111222832"] Jul 29 20:09:18.834006 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:18.833989 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111222832" Jul 29 20:09:18.836267 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:18.836249 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lq9lk\"" Jul 29 20:09:18.841739 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:18.841637 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7535-140196111222832"] Jul 29 20:09:18.912781 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:18.912748 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j225l\" (UniqueName: \"kubernetes.io/projected/70996f5b-7d85-4d20-9c98-59899aa5f632-kube-api-access-j225l\") pod \"test-curl-7535-140196111222832\" (UID: \"70996f5b-7d85-4d20-9c98-59899aa5f632\") " pod="opendatahub/test-curl-7535-140196111222832" Jul 29 20:09:19.014193 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:19.014143 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j225l\" (UniqueName: \"kubernetes.io/projected/70996f5b-7d85-4d20-9c98-59899aa5f632-kube-api-access-j225l\") pod \"test-curl-7535-140196111222832\" (UID: \"70996f5b-7d85-4d20-9c98-59899aa5f632\") " pod="opendatahub/test-curl-7535-140196111222832" Jul 29 20:09:19.022366 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:19.022340 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j225l\" (UniqueName: \"kubernetes.io/projected/70996f5b-7d85-4d20-9c98-59899aa5f632-kube-api-access-j225l\") pod \"test-curl-7535-140196111222832\" (UID: \"70996f5b-7d85-4d20-9c98-59899aa5f632\") " pod="opendatahub/test-curl-7535-140196111222832" Jul 29 20:09:19.144300 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:19.144266 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111222832" Jul 29 20:09:19.484038 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:19.484010 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7535-140196111222832"] Jul 29 20:09:19.485885 ip-10-0-136-162 kubenswrapper[2574]: W0729 20:09:19.485855 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70996f5b_7d85_4d20_9c98_59899aa5f632.slice/crio-4f32a769b0920bbbb9be09e2c8b9cf18b6be1eed70aec0150557b5ea028e3365 WatchSource:0}: Error finding container 4f32a769b0920bbbb9be09e2c8b9cf18b6be1eed70aec0150557b5ea028e3365: Status 404 returned error can't find the container with id 4f32a769b0920bbbb9be09e2c8b9cf18b6be1eed70aec0150557b5ea028e3365 Jul 29 20:09:20.071483 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:20.071440 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7535-140196111222832" event={"ID":"70996f5b-7d85-4d20-9c98-59899aa5f632","Type":"ContainerStarted","Data":"4f32a769b0920bbbb9be09e2c8b9cf18b6be1eed70aec0150557b5ea028e3365"} Jul 29 20:09:21.079170 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:21.079135 2574 generic.go:356] "Generic (PLEG): container finished" podID="70996f5b-7d85-4d20-9c98-59899aa5f632" containerID="cbb9c86b5503783e3b04817df1cf808b6de7526cb73106c3e4a4fe768d141754" exitCode=0 Jul 29 20:09:21.079599 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:21.079225 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7535-140196111222832" event={"ID":"70996f5b-7d85-4d20-9c98-59899aa5f632","Type":"ContainerDied","Data":"cbb9c86b5503783e3b04817df1cf808b6de7526cb73106c3e4a4fe768d141754"} Jul 29 20:09:22.222238 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.222213 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111222832" Jul 29 20:09:22.242312 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.242283 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7535-140196111222832_70996f5b-7d85-4d20-9c98-59899aa5f632/test-curl-7535-140196111222832/0.log" Jul 29 20:09:22.266345 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.266317 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7535-140196111222832"] Jul 29 20:09:22.269941 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.269922 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7535-140196111222832"] Jul 29 20:09:22.342856 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.342793 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j225l\" (UniqueName: \"kubernetes.io/projected/70996f5b-7d85-4d20-9c98-59899aa5f632-kube-api-access-j225l\") pod \"70996f5b-7d85-4d20-9c98-59899aa5f632\" (UID: \"70996f5b-7d85-4d20-9c98-59899aa5f632\") " Jul 29 20:09:22.344899 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.344873 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70996f5b-7d85-4d20-9c98-59899aa5f632-kube-api-access-j225l" (OuterVolumeSpecName: "kube-api-access-j225l") pod "70996f5b-7d85-4d20-9c98-59899aa5f632" (UID: "70996f5b-7d85-4d20-9c98-59899aa5f632"). InnerVolumeSpecName "kube-api-access-j225l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:09:22.399967 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.399939 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7535-140196111099056"] Jul 29 20:09:22.400341 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.400323 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70996f5b-7d85-4d20-9c98-59899aa5f632" containerName="test-curl-7535-140196111222832" Jul 29 20:09:22.400341 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.400339 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="70996f5b-7d85-4d20-9c98-59899aa5f632" containerName="test-curl-7535-140196111222832" Jul 29 20:09:22.400461 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.400422 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="70996f5b-7d85-4d20-9c98-59899aa5f632" containerName="test-curl-7535-140196111222832" Jul 29 20:09:22.403532 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.403501 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111099056" Jul 29 20:09:22.410362 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.410336 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7535-140196111099056"] Jul 29 20:09:22.443666 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.443641 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j225l\" (UniqueName: \"kubernetes.io/projected/70996f5b-7d85-4d20-9c98-59899aa5f632-kube-api-access-j225l\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:09:22.544717 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.544679 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2j6s\" (UniqueName: \"kubernetes.io/projected/c60fbddd-0757-4d03-a859-63f7d0ab1c6c-kube-api-access-f2j6s\") pod \"test-curl-7535-140196111099056\" (UID: \"c60fbddd-0757-4d03-a859-63f7d0ab1c6c\") " pod="opendatahub/test-curl-7535-140196111099056" Jul 29 20:09:22.645170 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.645141 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2j6s\" (UniqueName: \"kubernetes.io/projected/c60fbddd-0757-4d03-a859-63f7d0ab1c6c-kube-api-access-f2j6s\") pod \"test-curl-7535-140196111099056\" (UID: \"c60fbddd-0757-4d03-a859-63f7d0ab1c6c\") " pod="opendatahub/test-curl-7535-140196111099056" Jul 29 20:09:22.652674 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.652652 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2j6s\" (UniqueName: \"kubernetes.io/projected/c60fbddd-0757-4d03-a859-63f7d0ab1c6c-kube-api-access-f2j6s\") pod \"test-curl-7535-140196111099056\" (UID: \"c60fbddd-0757-4d03-a859-63f7d0ab1c6c\") " pod="opendatahub/test-curl-7535-140196111099056" Jul 29 20:09:22.714373 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.714344 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111099056" Jul 29 20:09:22.735128 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.735103 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70996f5b-7d85-4d20-9c98-59899aa5f632" path="/var/lib/kubelet/pods/70996f5b-7d85-4d20-9c98-59899aa5f632/volumes" Jul 29 20:09:22.846328 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:22.846299 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7535-140196111099056"] Jul 29 20:09:22.847852 ip-10-0-136-162 kubenswrapper[2574]: W0729 20:09:22.847828 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc60fbddd_0757_4d03_a859_63f7d0ab1c6c.slice/crio-ee646ceb8f7f0a55e67ef45711731b6f8f5cb9cdd35c397697ae7cb38874c4b6 WatchSource:0}: Error finding container ee646ceb8f7f0a55e67ef45711731b6f8f5cb9cdd35c397697ae7cb38874c4b6: Status 404 returned error can't find the container with id ee646ceb8f7f0a55e67ef45711731b6f8f5cb9cdd35c397697ae7cb38874c4b6 Jul 29 20:09:23.091753 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:23.091720 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111222832" Jul 29 20:09:23.091948 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:23.091767 2574 scope.go:117] "RemoveContainer" containerID="cbb9c86b5503783e3b04817df1cf808b6de7526cb73106c3e4a4fe768d141754" Jul 29 20:09:23.093054 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:23.092902 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7535-140196111099056" event={"ID":"c60fbddd-0757-4d03-a859-63f7d0ab1c6c","Type":"ContainerStarted","Data":"ee646ceb8f7f0a55e67ef45711731b6f8f5cb9cdd35c397697ae7cb38874c4b6"} Jul 29 20:09:23.435472 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:23.435382 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" Jul 29 20:09:23.435944 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:23.435482 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" Jul 29 20:09:23.456199 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:23.456171 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" Jul 29 20:09:24.100599 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:24.100553 2574 generic.go:356] "Generic (PLEG): container finished" podID="c60fbddd-0757-4d03-a859-63f7d0ab1c6c" containerID="7495ca217055cd2ab44d6a63d6a760bbdb06e7be02e5e3ad32b0bce3e9087a19" exitCode=0 Jul 29 20:09:24.100786 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:24.100637 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7535-140196111099056" event={"ID":"c60fbddd-0757-4d03-a859-63f7d0ab1c6c","Type":"ContainerDied","Data":"7495ca217055cd2ab44d6a63d6a760bbdb06e7be02e5e3ad32b0bce3e9087a19"} Jul 29 20:09:24.122240 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:24.122213 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" Jul 29 20:09:24.156853 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:24.156824 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pgsgl"] Jul 29 20:09:25.251452 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.251428 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111099056" Jul 29 20:09:25.271662 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.271625 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7535-140196111099056_c60fbddd-0757-4d03-a859-63f7d0ab1c6c/test-curl-7535-140196111099056/0.log" Jul 29 20:09:25.299082 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.299055 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7535-140196111099056"] Jul 29 20:09:25.302651 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.302631 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7535-140196111099056"] Jul 29 20:09:25.372544 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.372453 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2j6s\" (UniqueName: \"kubernetes.io/projected/c60fbddd-0757-4d03-a859-63f7d0ab1c6c-kube-api-access-f2j6s\") pod \"c60fbddd-0757-4d03-a859-63f7d0ab1c6c\" (UID: \"c60fbddd-0757-4d03-a859-63f7d0ab1c6c\") " Jul 29 20:09:25.374541 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.374495 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c60fbddd-0757-4d03-a859-63f7d0ab1c6c-kube-api-access-f2j6s" (OuterVolumeSpecName: "kube-api-access-f2j6s") pod "c60fbddd-0757-4d03-a859-63f7d0ab1c6c" (UID: "c60fbddd-0757-4d03-a859-63f7d0ab1c6c"). InnerVolumeSpecName "kube-api-access-f2j6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:09:25.473630 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.473591 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2j6s\" (UniqueName: \"kubernetes.io/projected/c60fbddd-0757-4d03-a859-63f7d0ab1c6c-kube-api-access-f2j6s\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:09:25.546691 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.546665 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7535-140196111116304"] Jul 29 20:09:25.547058 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.547046 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c60fbddd-0757-4d03-a859-63f7d0ab1c6c" containerName="test-curl-7535-140196111099056" Jul 29 20:09:25.547113 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.547060 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c60fbddd-0757-4d03-a859-63f7d0ab1c6c" containerName="test-curl-7535-140196111099056" Jul 29 20:09:25.547153 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.547144 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c60fbddd-0757-4d03-a859-63f7d0ab1c6c" containerName="test-curl-7535-140196111099056" Jul 29 20:09:25.550113 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.550098 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111116304" Jul 29 20:09:25.556177 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.556156 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7535-140196111116304"] Jul 29 20:09:25.675900 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.675869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcsmg\" (UniqueName: \"kubernetes.io/projected/debcca38-167a-4bbd-8e99-179943891cb8-kube-api-access-hcsmg\") pod \"test-curl-7535-140196111116304\" (UID: \"debcca38-167a-4bbd-8e99-179943891cb8\") " pod="opendatahub/test-curl-7535-140196111116304" Jul 29 20:09:25.776897 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.776866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcsmg\" (UniqueName: \"kubernetes.io/projected/debcca38-167a-4bbd-8e99-179943891cb8-kube-api-access-hcsmg\") pod \"test-curl-7535-140196111116304\" (UID: \"debcca38-167a-4bbd-8e99-179943891cb8\") " pod="opendatahub/test-curl-7535-140196111116304" Jul 29 20:09:25.784143 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.784113 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcsmg\" (UniqueName: \"kubernetes.io/projected/debcca38-167a-4bbd-8e99-179943891cb8-kube-api-access-hcsmg\") pod \"test-curl-7535-140196111116304\" (UID: \"debcca38-167a-4bbd-8e99-179943891cb8\") " pod="opendatahub/test-curl-7535-140196111116304" Jul 29 20:09:25.861376 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.861343 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111116304" Jul 29 20:09:25.992702 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:25.992675 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7535-140196111116304"] Jul 29 20:09:25.994271 ip-10-0-136-162 kubenswrapper[2574]: W0729 20:09:25.994238 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddebcca38_167a_4bbd_8e99_179943891cb8.slice/crio-a30736cf1c9f3ac3d173efc33eeab0fc1e73eed39d97fd8483362218fc3c6758 WatchSource:0}: Error finding container a30736cf1c9f3ac3d173efc33eeab0fc1e73eed39d97fd8483362218fc3c6758: Status 404 returned error can't find the container with id a30736cf1c9f3ac3d173efc33eeab0fc1e73eed39d97fd8483362218fc3c6758 Jul 29 20:09:26.115577 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:26.115544 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7535-140196111116304" event={"ID":"debcca38-167a-4bbd-8e99-179943891cb8","Type":"ContainerStarted","Data":"a30736cf1c9f3ac3d173efc33eeab0fc1e73eed39d97fd8483362218fc3c6758"} Jul 29 20:09:26.116751 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:26.116732 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111099056" Jul 29 20:09:26.116865 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:26.116773 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee646ceb8f7f0a55e67ef45711731b6f8f5cb9cdd35c397697ae7cb38874c4b6" Jul 29 20:09:26.116865 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:26.116797 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" podUID="1e17fad5-d1af-457a-8464-e297c82f0685" containerName="registry-server" containerID="cri-o://a9c5ed2c6917a1899890448ec927db27982e9be961319ddd239ca9111ca7e676" gracePeriod=2 Jul 29 20:09:26.133431 ip-10-0-136-162 kubenswrapper[2574]: E0729 20:09:26.133395 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7535-140196111099056\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="c60fbddd-0757-4d03-a859-63f7d0ab1c6c" pod="opendatahub/test-curl-7535-140196111099056" Jul 29 20:09:26.378803 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:26.378783 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" Jul 29 20:09:26.393896 ip-10-0-136-162 kubenswrapper[2574]: E0729 20:09:26.393860 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7535-140196111099056\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="c60fbddd-0757-4d03-a859-63f7d0ab1c6c" pod="opendatahub/test-curl-7535-140196111099056" Jul 29 20:09:26.484150 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:26.484086 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g49p8\" (UniqueName: \"kubernetes.io/projected/1e17fad5-d1af-457a-8464-e297c82f0685-kube-api-access-g49p8\") pod \"1e17fad5-d1af-457a-8464-e297c82f0685\" (UID: \"1e17fad5-d1af-457a-8464-e297c82f0685\") " Jul 29 20:09:26.486075 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:26.486051 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e17fad5-d1af-457a-8464-e297c82f0685-kube-api-access-g49p8" (OuterVolumeSpecName: "kube-api-access-g49p8") pod "1e17fad5-d1af-457a-8464-e297c82f0685" (UID: "1e17fad5-d1af-457a-8464-e297c82f0685"). InnerVolumeSpecName "kube-api-access-g49p8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:09:26.585624 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:26.585590 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g49p8\" (UniqueName: \"kubernetes.io/projected/1e17fad5-d1af-457a-8464-e297c82f0685-kube-api-access-g49p8\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:09:26.734571 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:26.734484 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c60fbddd-0757-4d03-a859-63f7d0ab1c6c" path="/var/lib/kubelet/pods/c60fbddd-0757-4d03-a859-63f7d0ab1c6c/volumes" Jul 29 20:09:27.123123 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:27.123033 2574 generic.go:356] "Generic (PLEG): container finished" podID="1e17fad5-d1af-457a-8464-e297c82f0685" containerID="a9c5ed2c6917a1899890448ec927db27982e9be961319ddd239ca9111ca7e676" exitCode=0 Jul 29 20:09:27.123123 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:27.123078 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" Jul 29 20:09:27.123323 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:27.123119 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" event={"ID":"1e17fad5-d1af-457a-8464-e297c82f0685","Type":"ContainerDied","Data":"a9c5ed2c6917a1899890448ec927db27982e9be961319ddd239ca9111ca7e676"} Jul 29 20:09:27.123323 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:27.123172 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pgsgl" event={"ID":"1e17fad5-d1af-457a-8464-e297c82f0685","Type":"ContainerDied","Data":"d66b1754bce6ad5ef52b0aded43d114232b0ddc30ab45867b8e441c6f979492c"} Jul 29 20:09:27.123323 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:27.123198 2574 scope.go:117] "RemoveContainer" containerID="a9c5ed2c6917a1899890448ec927db27982e9be961319ddd239ca9111ca7e676" Jul 29 20:09:27.124626 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:27.124607 2574 generic.go:356] "Generic (PLEG): container finished" podID="debcca38-167a-4bbd-8e99-179943891cb8" containerID="a87206fe3907e793b83becac1c3111f02e190fdfe763b8c99c7e5f6bf015a6a2" exitCode=0 Jul 29 20:09:27.124762 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:27.124735 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7535-140196111116304" event={"ID":"debcca38-167a-4bbd-8e99-179943891cb8","Type":"ContainerDied","Data":"a87206fe3907e793b83becac1c3111f02e190fdfe763b8c99c7e5f6bf015a6a2"} Jul 29 20:09:27.132880 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:27.132851 2574 scope.go:117] "RemoveContainer" containerID="a9c5ed2c6917a1899890448ec927db27982e9be961319ddd239ca9111ca7e676" Jul 29 20:09:27.133095 ip-10-0-136-162 kubenswrapper[2574]: E0729 20:09:27.133077 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9c5ed2c6917a1899890448ec927db27982e9be961319ddd239ca9111ca7e676\": container with ID starting with a9c5ed2c6917a1899890448ec927db27982e9be961319ddd239ca9111ca7e676 not found: ID does not exist" containerID="a9c5ed2c6917a1899890448ec927db27982e9be961319ddd239ca9111ca7e676" Jul 29 20:09:27.133138 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:27.133106 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c5ed2c6917a1899890448ec927db27982e9be961319ddd239ca9111ca7e676"} err="failed to get container status \"a9c5ed2c6917a1899890448ec927db27982e9be961319ddd239ca9111ca7e676\": rpc error: code = NotFound desc = could not find container \"a9c5ed2c6917a1899890448ec927db27982e9be961319ddd239ca9111ca7e676\": container with ID starting with a9c5ed2c6917a1899890448ec927db27982e9be961319ddd239ca9111ca7e676 not found: ID does not exist" Jul 29 20:09:27.138559 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:27.138540 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pgsgl"] Jul 29 20:09:27.142449 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:27.142427 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pgsgl"] Jul 29 20:09:28.266166 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.266142 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111116304" Jul 29 20:09:28.289032 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.288993 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7535-140196111116304_debcca38-167a-4bbd-8e99-179943891cb8/test-curl-7535-140196111116304/0.log" Jul 29 20:09:28.313572 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.313545 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7535-140196111116304"] Jul 29 20:09:28.316984 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.316964 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7535-140196111116304"] Jul 29 20:09:28.402129 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.402108 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcsmg\" (UniqueName: \"kubernetes.io/projected/debcca38-167a-4bbd-8e99-179943891cb8-kube-api-access-hcsmg\") pod \"debcca38-167a-4bbd-8e99-179943891cb8\" (UID: \"debcca38-167a-4bbd-8e99-179943891cb8\") " Jul 29 20:09:28.404115 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.404095 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/debcca38-167a-4bbd-8e99-179943891cb8-kube-api-access-hcsmg" (OuterVolumeSpecName: "kube-api-access-hcsmg") pod "debcca38-167a-4bbd-8e99-179943891cb8" (UID: "debcca38-167a-4bbd-8e99-179943891cb8"). InnerVolumeSpecName "kube-api-access-hcsmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:09:28.440703 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.440676 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7535-140196111116304"] Jul 29 20:09:28.441111 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.441098 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e17fad5-d1af-457a-8464-e297c82f0685" containerName="registry-server" Jul 29 20:09:28.441159 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.441112 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e17fad5-d1af-457a-8464-e297c82f0685" containerName="registry-server" Jul 29 20:09:28.441159 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.441125 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="debcca38-167a-4bbd-8e99-179943891cb8" containerName="test-curl-7535-140196111116304" Jul 29 20:09:28.441159 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.441131 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="debcca38-167a-4bbd-8e99-179943891cb8" containerName="test-curl-7535-140196111116304" Jul 29 20:09:28.441257 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.441191 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e17fad5-d1af-457a-8464-e297c82f0685" containerName="registry-server" Jul 29 20:09:28.441257 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.441203 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="debcca38-167a-4bbd-8e99-179943891cb8" containerName="test-curl-7535-140196111116304" Jul 29 20:09:28.444217 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.444203 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111116304" Jul 29 20:09:28.450095 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.450071 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7535-140196111116304"] Jul 29 20:09:28.503628 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.503598 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcsmg\" (UniqueName: \"kubernetes.io/projected/debcca38-167a-4bbd-8e99-179943891cb8-kube-api-access-hcsmg\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:09:28.605024 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.604993 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l68nb\" (UniqueName: \"kubernetes.io/projected/0020c376-1d41-4ed7-8668-d35bac23e8fa-kube-api-access-l68nb\") pod \"test-curl-7535-140196111116304\" (UID: \"0020c376-1d41-4ed7-8668-d35bac23e8fa\") " pod="opendatahub/test-curl-7535-140196111116304" Jul 29 20:09:28.705924 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.705850 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l68nb\" (UniqueName: \"kubernetes.io/projected/0020c376-1d41-4ed7-8668-d35bac23e8fa-kube-api-access-l68nb\") pod \"test-curl-7535-140196111116304\" (UID: \"0020c376-1d41-4ed7-8668-d35bac23e8fa\") " pod="opendatahub/test-curl-7535-140196111116304" Jul 29 20:09:28.719920 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.719902 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l68nb\" (UniqueName: \"kubernetes.io/projected/0020c376-1d41-4ed7-8668-d35bac23e8fa-kube-api-access-l68nb\") pod \"test-curl-7535-140196111116304\" (UID: \"0020c376-1d41-4ed7-8668-d35bac23e8fa\") " pod="opendatahub/test-curl-7535-140196111116304" Jul 29 20:09:28.734169 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.734141 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e17fad5-d1af-457a-8464-e297c82f0685" path="/var/lib/kubelet/pods/1e17fad5-d1af-457a-8464-e297c82f0685/volumes" Jul 29 20:09:28.734475 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.734462 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="debcca38-167a-4bbd-8e99-179943891cb8" path="/var/lib/kubelet/pods/debcca38-167a-4bbd-8e99-179943891cb8/volumes" Jul 29 20:09:28.756118 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.756093 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111116304" Jul 29 20:09:28.893159 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:28.893131 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7535-140196111116304"] Jul 29 20:09:28.894375 ip-10-0-136-162 kubenswrapper[2574]: W0729 20:09:28.894347 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0020c376_1d41_4ed7_8668_d35bac23e8fa.slice/crio-9d3f89471fc9b8606ee8d9268f845f24cd4f98aa77832f24379f5c388295cc9e WatchSource:0}: Error finding container 9d3f89471fc9b8606ee8d9268f845f24cd4f98aa77832f24379f5c388295cc9e: Status 404 returned error can't find the container with id 9d3f89471fc9b8606ee8d9268f845f24cd4f98aa77832f24379f5c388295cc9e Jul 29 20:09:29.137418 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:29.137373 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111116304" Jul 29 20:09:29.137418 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:29.137411 2574 scope.go:117] "RemoveContainer" containerID="a87206fe3907e793b83becac1c3111f02e190fdfe763b8c99c7e5f6bf015a6a2" Jul 29 20:09:29.138715 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:29.138662 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7535-140196111116304" event={"ID":"0020c376-1d41-4ed7-8668-d35bac23e8fa","Type":"ContainerStarted","Data":"9d3f89471fc9b8606ee8d9268f845f24cd4f98aa77832f24379f5c388295cc9e"} Jul 29 20:09:30.146092 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:30.146055 2574 generic.go:356] "Generic (PLEG): container finished" podID="0020c376-1d41-4ed7-8668-d35bac23e8fa" containerID="e15391fe0772bc6f859f14e800aebe8068f3b281b47505e397aa544aca26085f" exitCode=0 Jul 29 20:09:30.146571 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:30.146141 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7535-140196111116304" event={"ID":"0020c376-1d41-4ed7-8668-d35bac23e8fa","Type":"ContainerDied","Data":"e15391fe0772bc6f859f14e800aebe8068f3b281b47505e397aa544aca26085f"} Jul 29 20:09:31.294712 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.294686 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111116304" Jul 29 20:09:31.315994 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.315968 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7535-140196111116304_0020c376-1d41-4ed7-8668-d35bac23e8fa/test-curl-7535-140196111116304/0.log" Jul 29 20:09:31.340346 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.340307 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7535-140196111116304"] Jul 29 20:09:31.344260 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.344232 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7535-140196111116304"] Jul 29 20:09:31.441031 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.440957 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l68nb\" (UniqueName: \"kubernetes.io/projected/0020c376-1d41-4ed7-8668-d35bac23e8fa-kube-api-access-l68nb\") pod \"0020c376-1d41-4ed7-8668-d35bac23e8fa\" (UID: \"0020c376-1d41-4ed7-8668-d35bac23e8fa\") " Jul 29 20:09:31.443005 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.442979 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0020c376-1d41-4ed7-8668-d35bac23e8fa-kube-api-access-l68nb" (OuterVolumeSpecName: "kube-api-access-l68nb") pod "0020c376-1d41-4ed7-8668-d35bac23e8fa" (UID: "0020c376-1d41-4ed7-8668-d35bac23e8fa"). InnerVolumeSpecName "kube-api-access-l68nb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:09:31.455716 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.455689 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7535-140196111117312"] Jul 29 20:09:31.456098 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.456085 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0020c376-1d41-4ed7-8668-d35bac23e8fa" containerName="test-curl-7535-140196111116304" Jul 29 20:09:31.456144 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.456100 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0020c376-1d41-4ed7-8668-d35bac23e8fa" containerName="test-curl-7535-140196111116304" Jul 29 20:09:31.456188 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.456178 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0020c376-1d41-4ed7-8668-d35bac23e8fa" containerName="test-curl-7535-140196111116304" Jul 29 20:09:31.459069 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.459055 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111117312" Jul 29 20:09:31.463263 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.463230 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7535-140196111117312"] Jul 29 20:09:31.542271 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.542240 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l68nb\" (UniqueName: \"kubernetes.io/projected/0020c376-1d41-4ed7-8668-d35bac23e8fa-kube-api-access-l68nb\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:09:31.643501 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.643466 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf8bl\" (UniqueName: \"kubernetes.io/projected/3efe46bf-a5e9-4125-8aa7-c9065ad11dc1-kube-api-access-qf8bl\") pod \"test-curl-7535-140196111117312\" (UID: \"3efe46bf-a5e9-4125-8aa7-c9065ad11dc1\") " pod="opendatahub/test-curl-7535-140196111117312" Jul 29 20:09:31.744455 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.744370 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf8bl\" (UniqueName: \"kubernetes.io/projected/3efe46bf-a5e9-4125-8aa7-c9065ad11dc1-kube-api-access-qf8bl\") pod \"test-curl-7535-140196111117312\" (UID: \"3efe46bf-a5e9-4125-8aa7-c9065ad11dc1\") " pod="opendatahub/test-curl-7535-140196111117312" Jul 29 20:09:31.752274 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.752249 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf8bl\" (UniqueName: \"kubernetes.io/projected/3efe46bf-a5e9-4125-8aa7-c9065ad11dc1-kube-api-access-qf8bl\") pod \"test-curl-7535-140196111117312\" (UID: \"3efe46bf-a5e9-4125-8aa7-c9065ad11dc1\") " pod="opendatahub/test-curl-7535-140196111117312" Jul 29 20:09:31.770053 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.770027 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111117312" Jul 29 20:09:31.904382 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:31.904353 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7535-140196111117312"] Jul 29 20:09:31.905613 ip-10-0-136-162 kubenswrapper[2574]: W0729 20:09:31.905578 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3efe46bf_a5e9_4125_8aa7_c9065ad11dc1.slice/crio-a23b1a695fd576a6e6b1720e3f73efa6130f33ec2b31fcb9b28f64088f8d6a28 WatchSource:0}: Error finding container a23b1a695fd576a6e6b1720e3f73efa6130f33ec2b31fcb9b28f64088f8d6a28: Status 404 returned error can't find the container with id a23b1a695fd576a6e6b1720e3f73efa6130f33ec2b31fcb9b28f64088f8d6a28 Jul 29 20:09:32.160096 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:32.160062 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7535-140196111117312" event={"ID":"3efe46bf-a5e9-4125-8aa7-c9065ad11dc1","Type":"ContainerStarted","Data":"a23b1a695fd576a6e6b1720e3f73efa6130f33ec2b31fcb9b28f64088f8d6a28"} Jul 29 20:09:32.161427 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:32.161387 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d3f89471fc9b8606ee8d9268f845f24cd4f98aa77832f24379f5c388295cc9e" Jul 29 20:09:32.161427 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:32.161419 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111116304" Jul 29 20:09:32.171662 ip-10-0-136-162 kubenswrapper[2574]: E0729 20:09:32.171635 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7535-140196111116304\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="0020c376-1d41-4ed7-8668-d35bac23e8fa" pod="opendatahub/test-curl-7535-140196111116304" Jul 29 20:09:32.737750 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:32.737711 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0020c376-1d41-4ed7-8668-d35bac23e8fa" path="/var/lib/kubelet/pods/0020c376-1d41-4ed7-8668-d35bac23e8fa/volumes" Jul 29 20:09:33.168806 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:33.168771 2574 generic.go:356] "Generic (PLEG): container finished" podID="3efe46bf-a5e9-4125-8aa7-c9065ad11dc1" containerID="4d64e5f23474e1692cb231c7b3820925119f0c821069726225d4fad8e56e4624" exitCode=0 Jul 29 20:09:33.168955 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:33.168853 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7535-140196111117312" event={"ID":"3efe46bf-a5e9-4125-8aa7-c9065ad11dc1","Type":"ContainerDied","Data":"4d64e5f23474e1692cb231c7b3820925119f0c821069726225d4fad8e56e4624"} Jul 29 20:09:34.313645 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:34.313615 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111117312" Jul 29 20:09:34.335982 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:34.335953 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7535-140196111117312_3efe46bf-a5e9-4125-8aa7-c9065ad11dc1/test-curl-7535-140196111117312/0.log" Jul 29 20:09:34.359780 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:34.359744 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7535-140196111117312"] Jul 29 20:09:34.363711 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:34.363677 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7535-140196111117312"] Jul 29 20:09:34.364464 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:34.364444 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf8bl\" (UniqueName: \"kubernetes.io/projected/3efe46bf-a5e9-4125-8aa7-c9065ad11dc1-kube-api-access-qf8bl\") pod \"3efe46bf-a5e9-4125-8aa7-c9065ad11dc1\" (UID: \"3efe46bf-a5e9-4125-8aa7-c9065ad11dc1\") " Jul 29 20:09:34.366493 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:34.366462 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3efe46bf-a5e9-4125-8aa7-c9065ad11dc1-kube-api-access-qf8bl" (OuterVolumeSpecName: "kube-api-access-qf8bl") pod "3efe46bf-a5e9-4125-8aa7-c9065ad11dc1" (UID: "3efe46bf-a5e9-4125-8aa7-c9065ad11dc1"). InnerVolumeSpecName "kube-api-access-qf8bl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:09:34.465688 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:34.465603 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf8bl\" (UniqueName: \"kubernetes.io/projected/3efe46bf-a5e9-4125-8aa7-c9065ad11dc1-kube-api-access-qf8bl\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:09:34.734222 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:34.734121 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3efe46bf-a5e9-4125-8aa7-c9065ad11dc1" path="/var/lib/kubelet/pods/3efe46bf-a5e9-4125-8aa7-c9065ad11dc1/volumes" Jul 29 20:09:35.180762 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:35.180733 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7535-140196111117312" Jul 29 20:09:35.180762 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:35.180752 2574 scope.go:117] "RemoveContainer" containerID="4d64e5f23474e1692cb231c7b3820925119f0c821069726225d4fad8e56e4624" Jul 29 20:09:38.218454 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.218417 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:09:38.489307 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.489227 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j"] Jul 29 20:09:38.489906 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.489888 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3efe46bf-a5e9-4125-8aa7-c9065ad11dc1" containerName="test-curl-7535-140196111117312" Jul 29 20:09:38.489969 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.489909 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3efe46bf-a5e9-4125-8aa7-c9065ad11dc1" containerName="test-curl-7535-140196111117312" Jul 29 20:09:38.490006 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.489980 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3efe46bf-a5e9-4125-8aa7-c9065ad11dc1" containerName="test-curl-7535-140196111117312" Jul 29 20:09:38.494423 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.494404 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.496734 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.496709 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-fb0399-openshift-default-dockercfg-7p2hc\"" Jul 29 20:09:38.506420 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.506398 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j"] Jul 29 20:09:38.517259 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.517230 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:09:38.603278 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.603240 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-workload-socket\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.603496 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.603306 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-data\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.603496 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.603356 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-token\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.603496 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.603387 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9llkv\" (UniqueName: \"kubernetes.io/projected/32f56675-5fac-4c59-9978-5eaae24be6bf-kube-api-access-9llkv\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.603496 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.603418 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-podinfo\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.603496 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.603450 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32f56675-5fac-4c59-9978-5eaae24be6bf-istiod-ca-cert\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.603732 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.603605 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-credential-socket\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.603732 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.603639 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-envoy\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.603732 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.603706 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-workload-certs\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.705254 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.705217 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-token\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.705450 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.705264 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9llkv\" (UniqueName: \"kubernetes.io/projected/32f56675-5fac-4c59-9978-5eaae24be6bf-kube-api-access-9llkv\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.705450 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.705294 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-podinfo\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.705450 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.705329 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32f56675-5fac-4c59-9978-5eaae24be6bf-istiod-ca-cert\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.705653 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.705475 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-credential-socket\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.705653 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.705560 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-envoy\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.705653 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.705608 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-workload-certs\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.705799 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.705666 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-workload-socket\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.705799 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.705704 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-data\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.705905 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.705886 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-credential-socket\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.706076 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.706044 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-data\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.706076 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.706068 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-workload-certs\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.706203 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.706147 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32f56675-5fac-4c59-9978-5eaae24be6bf-istiod-ca-cert\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.706259 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.706213 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-workload-socket\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.707832 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.707808 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-envoy\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.708033 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.708018 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-podinfo\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.713848 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.713822 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9llkv\" (UniqueName: \"kubernetes.io/projected/32f56675-5fac-4c59-9978-5eaae24be6bf-kube-api-access-9llkv\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.713940 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.713892 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-token\") pod \"e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.806643 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.806547 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:38.936630 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.936596 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:09:38.949597 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.949573 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j"] Jul 29 20:09:38.950901 ip-10-0-136-162 kubenswrapper[2574]: W0729 20:09:38.950878 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32f56675_5fac_4c59_9978_5eaae24be6bf.slice/crio-40724f7d22934046e448dcb025b11e5966c0c32bcab408cd3f79f7c2912253a6 WatchSource:0}: Error finding container 40724f7d22934046e448dcb025b11e5966c0c32bcab408cd3f79f7c2912253a6: Status 404 returned error can't find the container with id 40724f7d22934046e448dcb025b11e5966c0c32bcab408cd3f79f7c2912253a6 Jul 29 20:09:38.952901 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.952870 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 20:09:38.952986 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.952932 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 20:09:38.952986 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:38.952959 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 20:09:39.206162 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:39.206123 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" event={"ID":"32f56675-5fac-4c59-9978-5eaae24be6bf","Type":"ContainerStarted","Data":"7a8d5b6ffc766ef67dcb0ae5b57b27788c64d98c5aa1059f3aa9b2415cbdd8a9"} Jul 29 20:09:39.206330 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:39.206184 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" event={"ID":"32f56675-5fac-4c59-9978-5eaae24be6bf","Type":"ContainerStarted","Data":"40724f7d22934046e448dcb025b11e5966c0c32bcab408cd3f79f7c2912253a6"} Jul 29 20:09:39.226227 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:39.226174 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" podStartSLOduration=1.226158753 podStartE2EDuration="1.226158753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:09:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:09:39.224026678 +0000 UTC m=+3169.112333929" watchObservedRunningTime="2026-07-29 20:09:39.226158753 +0000 UTC m=+3169.114466050" Jul 29 20:09:39.807044 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:39.807011 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:40.812371 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:40.812343 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:41.110045 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:41.109962 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:09:41.193741 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:41.193685 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:09:41.219453 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:41.219418 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:41.220604 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:41.220578 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:41.263052 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:41.263021 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:09:41.453041 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:41.453011 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:09:41.793452 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:41.793341 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:09:41.893053 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:41.893019 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:09:57.260678 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:57.260624 2574 patch_prober.go:28] interesting pod/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 29 20:09:57.261092 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:57.260699 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" podUID="32f56675-5fac-4c59-9978-5eaae24be6bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 29 20:09:58.329725 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:58.329689 2574 generic.go:356] "Generic (PLEG): container finished" podID="32f56675-5fac-4c59-9978-5eaae24be6bf" containerID="7a8d5b6ffc766ef67dcb0ae5b57b27788c64d98c5aa1059f3aa9b2415cbdd8a9" exitCode=0 Jul 29 20:09:58.330281 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:58.329763 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" event={"ID":"32f56675-5fac-4c59-9978-5eaae24be6bf","Type":"ContainerDied","Data":"7a8d5b6ffc766ef67dcb0ae5b57b27788c64d98c5aa1059f3aa9b2415cbdd8a9"} Jul 29 20:09:58.330362 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:58.330299 2574 scope.go:117] "RemoveContainer" containerID="7a8d5b6ffc766ef67dcb0ae5b57b27788c64d98c5aa1059f3aa9b2415cbdd8a9" Jul 29 20:09:58.331356 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:58.331324 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 20:09:58.331460 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:58.331394 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 20:09:58.331460 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:58.331422 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 20:09:59.336863 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:59.336825 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" event={"ID":"32f56675-5fac-4c59-9978-5eaae24be6bf","Type":"ContainerStarted","Data":"f8a3e5e09f08c8d7a534cba965e090f92dee2f3b352b3c2f3df1337002c5722e"} Jul 29 20:09:59.807173 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:59.807129 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:09:59.807435 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:59.807410 2574 patch_prober.go:28] interesting pod/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 29 20:09:59.807487 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:09:59.807461 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" podUID="32f56675-5fac-4c59-9978-5eaae24be6bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 29 20:10:00.807640 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:00.807608 2574 patch_prober.go:28] interesting pod/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 29 20:10:00.808022 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:00.807682 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" podUID="32f56675-5fac-4c59-9978-5eaae24be6bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 29 20:10:01.807531 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:01.807472 2574 patch_prober.go:28] interesting pod/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 29 20:10:01.807724 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:01.807570 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" podUID="32f56675-5fac-4c59-9978-5eaae24be6bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 29 20:10:02.807617 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:02.807578 2574 patch_prober.go:28] interesting pod/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 29 20:10:02.807817 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:02.807632 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" podUID="32f56675-5fac-4c59-9978-5eaae24be6bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 29 20:10:03.810610 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:03.810580 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:10:03.811063 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:03.810993 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:10:03.811705 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:03.811687 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:10:06.119071 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:06.119031 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:10:06.755737 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:06.755700 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:10:07.061670 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:07.061582 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:10:07.940970 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:07.940939 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:10:09.635343 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:09.635310 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:10:09.713296 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:09.713245 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:10:09.774307 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:09.774270 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:10:10.481761 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:10.481706 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:10:10.552234 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:10.552200 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:10:34.615447 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:34.615405 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:10:41.384878 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:41.384844 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-df4hx_1ece25a0-84ea-485c-b5e2-e69e7e2987c8/payload-processing/0.log" Jul 29 20:10:54.917120 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:10:54.917059 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:11:11.096285 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:11.096251 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:11:36.620345 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:36.620318 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-df4hx_1ece25a0-84ea-485c-b5e2-e69e7e2987c8/payload-processing/0.log" Jul 29 20:11:37.003785 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.003749 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:11:37.259503 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.259409 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9"] Jul 29 20:11:37.263055 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.263038 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.265093 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.265075 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-7720d1-openshift-default-dockercfg-5rx62\"" Jul 29 20:11:37.273656 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.273629 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9"] Jul 29 20:11:37.329400 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.329361 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7pm2\" (UniqueName: \"kubernetes.io/projected/0215057e-c05f-4735-8a28-d99c0cc5969f-kube-api-access-j7pm2\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.329570 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.329425 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-envoy\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.329570 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.329464 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-token\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.329570 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.329532 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-workload-socket\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.329570 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.329557 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-data\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.329735 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.329590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0215057e-c05f-4735-8a28-d99c0cc5969f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.329735 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.329628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-credential-socket\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.329735 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.329655 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-podinfo\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.329735 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.329724 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-workload-certs\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.430313 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.430271 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-workload-certs\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.430548 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.430336 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7pm2\" (UniqueName: \"kubernetes.io/projected/0215057e-c05f-4735-8a28-d99c0cc5969f-kube-api-access-j7pm2\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.430548 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.430378 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-envoy\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.430548 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.430412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-token\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.430548 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.430435 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-workload-socket\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.430548 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.430457 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-data\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.430548 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.430498 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0215057e-c05f-4735-8a28-d99c0cc5969f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.430890 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.430580 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-credential-socket\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.430890 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.430609 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-podinfo\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.430890 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.430770 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-workload-certs\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.430890 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.430856 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-workload-socket\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.431106 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.430946 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-data\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.431106 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.430982 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-credential-socket\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.431302 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.431274 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0215057e-c05f-4735-8a28-d99c0cc5969f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.433153 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.433123 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-envoy\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.433255 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.433230 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-podinfo\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.437788 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.437762 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-token\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.438044 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.438023 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7pm2\" (UniqueName: \"kubernetes.io/projected/0215057e-c05f-4735-8a28-d99c0cc5969f-kube-api-access-j7pm2\") pod \"e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.574577 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.574493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:37.723172 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.723145 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9"] Jul 29 20:11:37.725263 ip-10-0-136-162 kubenswrapper[2574]: W0729 20:11:37.725235 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0215057e_c05f_4735_8a28_d99c0cc5969f.slice/crio-90523f058ba25c58adea8be3bff5cac2eff70e6a51056e388064e659275ec004 WatchSource:0}: Error finding container 90523f058ba25c58adea8be3bff5cac2eff70e6a51056e388064e659275ec004: Status 404 returned error can't find the container with id 90523f058ba25c58adea8be3bff5cac2eff70e6a51056e388064e659275ec004 Jul 29 20:11:37.727635 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.727593 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 20:11:37.727731 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.727678 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 20:11:37.727731 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.727718 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 20:11:37.908475 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.908436 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" event={"ID":"0215057e-c05f-4735-8a28-d99c0cc5969f","Type":"ContainerStarted","Data":"cb2fc66f72ebdccd51008d6f657bfe940efa085706f041cf90560004759841be"} Jul 29 20:11:37.908681 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.908492 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" event={"ID":"0215057e-c05f-4735-8a28-d99c0cc5969f","Type":"ContainerStarted","Data":"90523f058ba25c58adea8be3bff5cac2eff70e6a51056e388064e659275ec004"} Jul 29 20:11:37.928688 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:37.928628 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" podStartSLOduration=0.928611143 podStartE2EDuration="928.611143ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 20:11:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:11:37.926163102 +0000 UTC m=+3287.814470331" watchObservedRunningTime="2026-07-29 20:11:37.928611143 +0000 UTC m=+3287.816918370" Jul 29 20:11:38.484963 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:38.484922 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:11:38.575595 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:38.575561 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:38.580363 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:38.580342 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:38.914695 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:38.914662 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:38.915641 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:38.915618 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:39.799925 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:39.799880 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:11:39.895491 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:39.895462 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:11:40.067631 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:40.067471 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:11:40.323591 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:40.323449 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:11:40.666503 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:40.666473 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:11:40.762227 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:40.762176 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:11:50.920429 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:50.920399 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 20:11:50.925618 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:50.925600 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 20:11:50.926134 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:50.926114 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 20:11:50.930984 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:50.930967 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dxx86_05e53a84-6c43-4a87-8e2a-fb5ecaaf8425/ovn-acl-logging/0.log" Jul 29 20:11:53.916236 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:53.916205 2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 29 20:11:53.916663 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:53.916275 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" podUID="0215057e-c05f-4735-8a28-d99c0cc5969f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 29 20:11:54.004674 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:54.004639 2574 generic.go:356] "Generic (PLEG): container finished" podID="0215057e-c05f-4735-8a28-d99c0cc5969f" containerID="cb2fc66f72ebdccd51008d6f657bfe940efa085706f041cf90560004759841be" exitCode=0 Jul 29 20:11:54.004843 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:54.004713 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" event={"ID":"0215057e-c05f-4735-8a28-d99c0cc5969f","Type":"ContainerDied","Data":"cb2fc66f72ebdccd51008d6f657bfe940efa085706f041cf90560004759841be"} Jul 29 20:11:54.005129 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:54.005116 2574 scope.go:117] "RemoveContainer" containerID="cb2fc66f72ebdccd51008d6f657bfe940efa085706f041cf90560004759841be" Jul 29 20:11:54.006315 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:54.006285 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 20:11:54.006375 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:54.006357 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 20:11:54.006413 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:54.006386 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 29 20:11:55.012236 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:55.012202 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" event={"ID":"0215057e-c05f-4735-8a28-d99c0cc5969f","Type":"ContainerStarted","Data":"f8011cd6df3b917d9e0624572b16a1ae8194c70667ff978f7ec54917f03487c1"} Jul 29 20:11:55.575616 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:55.575573 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:55.575838 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:55.575745 2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 29 20:11:55.575838 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:55.575803 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" podUID="0215057e-c05f-4735-8a28-d99c0cc5969f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 29 20:11:56.574989 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:56.574952 2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 29 20:11:56.575450 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:56.575030 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" podUID="0215057e-c05f-4735-8a28-d99c0cc5969f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 29 20:11:57.575264 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:57.575229 2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 29 20:11:57.575878 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:57.575843 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" podUID="0215057e-c05f-4735-8a28-d99c0cc5969f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 29 20:11:58.575950 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:58.575909 2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 29 20:11:58.576451 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:58.575982 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" podUID="0215057e-c05f-4735-8a28-d99c0cc5969f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 29 20:11:59.579198 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:59.579169 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:59.579656 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:59.579450 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:11:59.580308 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:11:59.580291 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:12:05.663092 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:05.663058 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:12:09.487054 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:09.487021 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:12:09.566340 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:09.566309 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:12:09.624129 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:09.624090 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:12:09.692985 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:09.692953 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:12:10.024363 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:10.024332 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:12:16.113207 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:16.113121 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:12:16.214865 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:16.214827 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:12:16.354732 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:16.354697 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9"] Jul 29 20:12:16.354930 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:16.354908 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" podUID="0215057e-c05f-4735-8a28-d99c0cc5969f" containerName="istio-proxy" containerID="cri-o://f8011cd6df3b917d9e0624572b16a1ae8194c70667ff978f7ec54917f03487c1" gracePeriod=30 Jul 29 20:12:16.412007 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:16.411977 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:12:16.581408 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:16.581365 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:12:21.610892 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.610867 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:12:21.749837 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.749802 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-workload-certs\") pod \"0215057e-c05f-4735-8a28-d99c0cc5969f\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " Jul 29 20:12:21.749837 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.749842 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-workload-socket\") pod \"0215057e-c05f-4735-8a28-d99c0cc5969f\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " Jul 29 20:12:21.750079 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.749866 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-data\") pod \"0215057e-c05f-4735-8a28-d99c0cc5969f\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " Jul 29 20:12:21.750079 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.749896 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-podinfo\") pod \"0215057e-c05f-4735-8a28-d99c0cc5969f\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " Jul 29 20:12:21.750079 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.749933 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-envoy\") pod \"0215057e-c05f-4735-8a28-d99c0cc5969f\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " Jul 29 20:12:21.750079 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.749976 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0215057e-c05f-4735-8a28-d99c0cc5969f-istiod-ca-cert\") pod \"0215057e-c05f-4735-8a28-d99c0cc5969f\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " Jul 29 20:12:21.750079 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.750058 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-token\") pod \"0215057e-c05f-4735-8a28-d99c0cc5969f\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " Jul 29 20:12:21.750343 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.750113 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-credential-socket\") pod \"0215057e-c05f-4735-8a28-d99c0cc5969f\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " Jul 29 20:12:21.750343 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.750127 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0215057e-c05f-4735-8a28-d99c0cc5969f" (UID: "0215057e-c05f-4735-8a28-d99c0cc5969f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:12:21.750343 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.750148 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7pm2\" (UniqueName: \"kubernetes.io/projected/0215057e-c05f-4735-8a28-d99c0cc5969f-kube-api-access-j7pm2\") pod \"0215057e-c05f-4735-8a28-d99c0cc5969f\" (UID: \"0215057e-c05f-4735-8a28-d99c0cc5969f\") " Jul 29 20:12:21.750343 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.750172 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0215057e-c05f-4735-8a28-d99c0cc5969f" (UID: "0215057e-c05f-4735-8a28-d99c0cc5969f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:12:21.750666 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.750355 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0215057e-c05f-4735-8a28-d99c0cc5969f" (UID: "0215057e-c05f-4735-8a28-d99c0cc5969f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:12:21.750666 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.750443 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0215057e-c05f-4735-8a28-d99c0cc5969f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0215057e-c05f-4735-8a28-d99c0cc5969f" (UID: "0215057e-c05f-4735-8a28-d99c0cc5969f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 20:12:21.750666 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.750557 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:12:21.750666 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.750584 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:12:21.750666 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.750603 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:12:21.751219 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.751195 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-data" (OuterVolumeSpecName: "istio-data") pod "0215057e-c05f-4735-8a28-d99c0cc5969f" (UID: "0215057e-c05f-4735-8a28-d99c0cc5969f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:12:21.752289 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.752266 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0215057e-c05f-4735-8a28-d99c0cc5969f" (UID: "0215057e-c05f-4735-8a28-d99c0cc5969f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:12:21.752397 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.752326 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0215057e-c05f-4735-8a28-d99c0cc5969f" (UID: "0215057e-c05f-4735-8a28-d99c0cc5969f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 20:12:21.752575 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.752548 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-token" (OuterVolumeSpecName: "istio-token") pod "0215057e-c05f-4735-8a28-d99c0cc5969f" (UID: "0215057e-c05f-4735-8a28-d99c0cc5969f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:12:21.752690 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.752646 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0215057e-c05f-4735-8a28-d99c0cc5969f-kube-api-access-j7pm2" (OuterVolumeSpecName: "kube-api-access-j7pm2") pod "0215057e-c05f-4735-8a28-d99c0cc5969f" (UID: "0215057e-c05f-4735-8a28-d99c0cc5969f"). InnerVolumeSpecName "kube-api-access-j7pm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:12:21.852020 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.851992 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:12:21.852020 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.852017 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7pm2\" (UniqueName: \"kubernetes.io/projected/0215057e-c05f-4735-8a28-d99c0cc5969f-kube-api-access-j7pm2\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:12:21.852179 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.852027 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:12:21.852179 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.852036 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:12:21.852179 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.852043 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0215057e-c05f-4735-8a28-d99c0cc5969f-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:12:21.852179 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:21.852051 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0215057e-c05f-4735-8a28-d99c0cc5969f-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:12:22.163740 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:22.163709 2574 generic.go:356] "Generic (PLEG): container finished" podID="0215057e-c05f-4735-8a28-d99c0cc5969f" containerID="f8011cd6df3b917d9e0624572b16a1ae8194c70667ff978f7ec54917f03487c1" exitCode=0 Jul 29 20:12:22.163917 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:22.163756 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" Jul 29 20:12:22.163917 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:22.163788 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" event={"ID":"0215057e-c05f-4735-8a28-d99c0cc5969f","Type":"ContainerDied","Data":"f8011cd6df3b917d9e0624572b16a1ae8194c70667ff978f7ec54917f03487c1"} Jul 29 20:12:22.163917 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:22.163844 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9" event={"ID":"0215057e-c05f-4735-8a28-d99c0cc5969f","Type":"ContainerDied","Data":"90523f058ba25c58adea8be3bff5cac2eff70e6a51056e388064e659275ec004"} Jul 29 20:12:22.163917 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:22.163873 2574 scope.go:117] "RemoveContainer" containerID="f8011cd6df3b917d9e0624572b16a1ae8194c70667ff978f7ec54917f03487c1" Jul 29 20:12:22.173988 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:22.173973 2574 scope.go:117] "RemoveContainer" containerID="cb2fc66f72ebdccd51008d6f657bfe940efa085706f041cf90560004759841be" Jul 29 20:12:22.182497 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:22.182480 2574 scope.go:117] "RemoveContainer" containerID="f8011cd6df3b917d9e0624572b16a1ae8194c70667ff978f7ec54917f03487c1" Jul 29 20:12:22.182774 ip-10-0-136-162 kubenswrapper[2574]: E0729 20:12:22.182756 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8011cd6df3b917d9e0624572b16a1ae8194c70667ff978f7ec54917f03487c1\": container with ID starting with f8011cd6df3b917d9e0624572b16a1ae8194c70667ff978f7ec54917f03487c1 not found: ID does not exist" containerID="f8011cd6df3b917d9e0624572b16a1ae8194c70667ff978f7ec54917f03487c1" Jul 29 20:12:22.182858 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:22.182781 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8011cd6df3b917d9e0624572b16a1ae8194c70667ff978f7ec54917f03487c1"} err="failed to get container status \"f8011cd6df3b917d9e0624572b16a1ae8194c70667ff978f7ec54917f03487c1\": rpc error: code = NotFound desc = could not find container \"f8011cd6df3b917d9e0624572b16a1ae8194c70667ff978f7ec54917f03487c1\": container with ID starting with f8011cd6df3b917d9e0624572b16a1ae8194c70667ff978f7ec54917f03487c1 not found: ID does not exist" Jul 29 20:12:22.182858 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:22.182799 2574 scope.go:117] "RemoveContainer" containerID="cb2fc66f72ebdccd51008d6f657bfe940efa085706f041cf90560004759841be" Jul 29 20:12:22.183278 ip-10-0-136-162 kubenswrapper[2574]: E0729 20:12:22.183196 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb2fc66f72ebdccd51008d6f657bfe940efa085706f041cf90560004759841be\": container with ID starting with cb2fc66f72ebdccd51008d6f657bfe940efa085706f041cf90560004759841be not found: ID does not exist" containerID="cb2fc66f72ebdccd51008d6f657bfe940efa085706f041cf90560004759841be" Jul 29 20:12:22.183278 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:22.183251 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb2fc66f72ebdccd51008d6f657bfe940efa085706f041cf90560004759841be"} err="failed to get container status \"cb2fc66f72ebdccd51008d6f657bfe940efa085706f041cf90560004759841be\": rpc error: code = NotFound desc = could not find container \"cb2fc66f72ebdccd51008d6f657bfe940efa085706f041cf90560004759841be\": container with ID starting with cb2fc66f72ebdccd51008d6f657bfe940efa085706f041cf90560004759841be not found: ID does not exist" Jul 29 20:12:22.186230 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:22.186211 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9"] Jul 29 20:12:22.190386 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:22.190364 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7720d1-openshift-default-78b6cfdfcd-pxln9"] Jul 29 20:12:22.733936 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:22.733901 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0215057e-c05f-4735-8a28-d99c0cc5969f" path="/var/lib/kubelet/pods/0215057e-c05f-4735-8a28-d99c0cc5969f/volumes" Jul 29 20:12:35.344461 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:35.344417 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:12:35.425234 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:35.425206 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:12:35.486489 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:35.486449 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:12:35.581783 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:35.581746 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:12:35.962592 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:35.962554 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:12:40.994304 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:12:40.994271 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:14.693965 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:14.693926 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:15.453495 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:15.453456 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:17.911774 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:17.911740 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:21.314327 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:21.314294 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:27.416558 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:27.416500 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:27.501681 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:27.501645 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:27.679801 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:27.679711 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j"] Jul 29 20:13:27.679962 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:27.679936 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" podUID="32f56675-5fac-4c59-9978-5eaae24be6bf" containerName="istio-proxy" containerID="cri-o://f8a3e5e09f08c8d7a534cba965e090f92dee2f3b352b3c2f3df1337002c5722e" gracePeriod=30 Jul 29 20:13:27.699646 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:27.699612 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:27.938733 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:27.938655 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:32.933651 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.933621 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:13:32.990472 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.990384 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9llkv\" (UniqueName: \"kubernetes.io/projected/32f56675-5fac-4c59-9978-5eaae24be6bf-kube-api-access-9llkv\") pod \"32f56675-5fac-4c59-9978-5eaae24be6bf\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " Jul 29 20:13:32.990472 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.990441 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-data\") pod \"32f56675-5fac-4c59-9978-5eaae24be6bf\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " Jul 29 20:13:32.990733 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.990477 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-workload-socket\") pod \"32f56675-5fac-4c59-9978-5eaae24be6bf\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " Jul 29 20:13:32.990733 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.990498 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-credential-socket\") pod \"32f56675-5fac-4c59-9978-5eaae24be6bf\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " Jul 29 20:13:32.990733 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.990535 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-workload-certs\") pod \"32f56675-5fac-4c59-9978-5eaae24be6bf\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " Jul 29 20:13:32.990733 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.990572 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-podinfo\") pod \"32f56675-5fac-4c59-9978-5eaae24be6bf\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " Jul 29 20:13:32.990733 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.990658 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-envoy\") pod \"32f56675-5fac-4c59-9978-5eaae24be6bf\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " Jul 29 20:13:32.991005 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.990814 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32f56675-5fac-4c59-9978-5eaae24be6bf-istiod-ca-cert\") pod \"32f56675-5fac-4c59-9978-5eaae24be6bf\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " Jul 29 20:13:32.991005 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.990850 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-token\") pod \"32f56675-5fac-4c59-9978-5eaae24be6bf\" (UID: \"32f56675-5fac-4c59-9978-5eaae24be6bf\") " Jul 29 20:13:32.991005 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.990863 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "32f56675-5fac-4c59-9978-5eaae24be6bf" (UID: "32f56675-5fac-4c59-9978-5eaae24be6bf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:13:32.991005 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.990884 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "32f56675-5fac-4c59-9978-5eaae24be6bf" (UID: "32f56675-5fac-4c59-9978-5eaae24be6bf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:13:32.991005 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.990897 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "32f56675-5fac-4c59-9978-5eaae24be6bf" (UID: "32f56675-5fac-4c59-9978-5eaae24be6bf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:13:32.991281 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.991175 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32f56675-5fac-4c59-9978-5eaae24be6bf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "32f56675-5fac-4c59-9978-5eaae24be6bf" (UID: "32f56675-5fac-4c59-9978-5eaae24be6bf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 20:13:32.991281 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.991257 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32f56675-5fac-4c59-9978-5eaae24be6bf-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:13:32.991281 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.991277 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:13:32.991446 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.991292 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:13:32.991446 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.991305 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:13:32.991573 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.991447 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-data" (OuterVolumeSpecName: "istio-data") pod "32f56675-5fac-4c59-9978-5eaae24be6bf" (UID: "32f56675-5fac-4c59-9978-5eaae24be6bf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:13:32.992794 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.992770 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "32f56675-5fac-4c59-9978-5eaae24be6bf" (UID: "32f56675-5fac-4c59-9978-5eaae24be6bf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:13:32.992907 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.992880 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "32f56675-5fac-4c59-9978-5eaae24be6bf" (UID: "32f56675-5fac-4c59-9978-5eaae24be6bf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 20:13:32.993093 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.993072 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32f56675-5fac-4c59-9978-5eaae24be6bf-kube-api-access-9llkv" (OuterVolumeSpecName: "kube-api-access-9llkv") pod "32f56675-5fac-4c59-9978-5eaae24be6bf" (UID: "32f56675-5fac-4c59-9978-5eaae24be6bf"). InnerVolumeSpecName "kube-api-access-9llkv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:13:32.993192 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:32.993168 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-token" (OuterVolumeSpecName: "istio-token") pod "32f56675-5fac-4c59-9978-5eaae24be6bf" (UID: "32f56675-5fac-4c59-9978-5eaae24be6bf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:13:33.092227 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.092192 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:13:33.092227 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.092222 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:13:33.092227 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.092231 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9llkv\" (UniqueName: \"kubernetes.io/projected/32f56675-5fac-4c59-9978-5eaae24be6bf-kube-api-access-9llkv\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:13:33.092471 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.092239 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:13:33.092471 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.092248 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32f56675-5fac-4c59-9978-5eaae24be6bf-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:13:33.580295 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.580260 2574 generic.go:356] "Generic (PLEG): container finished" podID="32f56675-5fac-4c59-9978-5eaae24be6bf" containerID="f8a3e5e09f08c8d7a534cba965e090f92dee2f3b352b3c2f3df1337002c5722e" exitCode=0 Jul 29 20:13:33.580461 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.580310 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" Jul 29 20:13:33.580461 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.580348 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" event={"ID":"32f56675-5fac-4c59-9978-5eaae24be6bf","Type":"ContainerDied","Data":"f8a3e5e09f08c8d7a534cba965e090f92dee2f3b352b3c2f3df1337002c5722e"} Jul 29 20:13:33.580461 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.580409 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j" event={"ID":"32f56675-5fac-4c59-9978-5eaae24be6bf","Type":"ContainerDied","Data":"40724f7d22934046e448dcb025b11e5966c0c32bcab408cd3f79f7c2912253a6"} Jul 29 20:13:33.580461 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.580440 2574 scope.go:117] "RemoveContainer" containerID="f8a3e5e09f08c8d7a534cba965e090f92dee2f3b352b3c2f3df1337002c5722e" Jul 29 20:13:33.590300 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.590283 2574 scope.go:117] "RemoveContainer" containerID="7a8d5b6ffc766ef67dcb0ae5b57b27788c64d98c5aa1059f3aa9b2415cbdd8a9" Jul 29 20:13:33.598523 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.598493 2574 scope.go:117] "RemoveContainer" containerID="f8a3e5e09f08c8d7a534cba965e090f92dee2f3b352b3c2f3df1337002c5722e" Jul 29 20:13:33.598769 ip-10-0-136-162 kubenswrapper[2574]: E0729 20:13:33.598750 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8a3e5e09f08c8d7a534cba965e090f92dee2f3b352b3c2f3df1337002c5722e\": container with ID starting with f8a3e5e09f08c8d7a534cba965e090f92dee2f3b352b3c2f3df1337002c5722e not found: ID does not exist" containerID="f8a3e5e09f08c8d7a534cba965e090f92dee2f3b352b3c2f3df1337002c5722e" Jul 29 20:13:33.598824 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.598777 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8a3e5e09f08c8d7a534cba965e090f92dee2f3b352b3c2f3df1337002c5722e"} err="failed to get container status \"f8a3e5e09f08c8d7a534cba965e090f92dee2f3b352b3c2f3df1337002c5722e\": rpc error: code = NotFound desc = could not find container \"f8a3e5e09f08c8d7a534cba965e090f92dee2f3b352b3c2f3df1337002c5722e\": container with ID starting with f8a3e5e09f08c8d7a534cba965e090f92dee2f3b352b3c2f3df1337002c5722e not found: ID does not exist" Jul 29 20:13:33.598824 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.598795 2574 scope.go:117] "RemoveContainer" containerID="7a8d5b6ffc766ef67dcb0ae5b57b27788c64d98c5aa1059f3aa9b2415cbdd8a9" Jul 29 20:13:33.599015 ip-10-0-136-162 kubenswrapper[2574]: E0729 20:13:33.598987 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a8d5b6ffc766ef67dcb0ae5b57b27788c64d98c5aa1059f3aa9b2415cbdd8a9\": container with ID starting with 7a8d5b6ffc766ef67dcb0ae5b57b27788c64d98c5aa1059f3aa9b2415cbdd8a9 not found: ID does not exist" containerID="7a8d5b6ffc766ef67dcb0ae5b57b27788c64d98c5aa1059f3aa9b2415cbdd8a9" Jul 29 20:13:33.599070 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.599023 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a8d5b6ffc766ef67dcb0ae5b57b27788c64d98c5aa1059f3aa9b2415cbdd8a9"} err="failed to get container status \"7a8d5b6ffc766ef67dcb0ae5b57b27788c64d98c5aa1059f3aa9b2415cbdd8a9\": rpc error: code = NotFound desc = could not find container \"7a8d5b6ffc766ef67dcb0ae5b57b27788c64d98c5aa1059f3aa9b2415cbdd8a9\": container with ID starting with 7a8d5b6ffc766ef67dcb0ae5b57b27788c64d98c5aa1059f3aa9b2415cbdd8a9 not found: ID does not exist" Jul 29 20:13:33.603408 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.603371 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j"] Jul 29 20:13:33.610208 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:33.610186 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-fb0399-openshift-default-6c64774b7b-chn6j"] Jul 29 20:13:34.734313 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:34.734277 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32f56675-5fac-4c59-9978-5eaae24be6bf" path="/var/lib/kubelet/pods/32f56675-5fac-4c59-9978-5eaae24be6bf/volumes" Jul 29 20:13:38.480376 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:38.480343 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:38.575178 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:38.575148 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:38.641226 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:38.641186 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:38.709276 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:38.709242 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:39.101675 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:39.101640 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:42.212748 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:42.212709 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:45.474199 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:45.474116 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:45.549324 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:45.549288 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:45.740617 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:45.740527 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:45.963082 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:45.963047 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:46.099371 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.099293 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a60880-hqfss"] Jul 29 20:13:46.099746 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.099731 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0215057e-c05f-4735-8a28-d99c0cc5969f" containerName="istio-proxy" Jul 29 20:13:46.099804 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.099748 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0215057e-c05f-4735-8a28-d99c0cc5969f" containerName="istio-proxy" Jul 29 20:13:46.099804 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.099765 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32f56675-5fac-4c59-9978-5eaae24be6bf" containerName="istio-proxy" Jul 29 20:13:46.099804 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.099771 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="32f56675-5fac-4c59-9978-5eaae24be6bf" containerName="istio-proxy" Jul 29 20:13:46.099804 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.099779 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32f56675-5fac-4c59-9978-5eaae24be6bf" containerName="istio-proxy" Jul 29 20:13:46.099804 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.099785 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="32f56675-5fac-4c59-9978-5eaae24be6bf" containerName="istio-proxy" Jul 29 20:13:46.099981 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.099861 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="32f56675-5fac-4c59-9978-5eaae24be6bf" containerName="istio-proxy" Jul 29 20:13:46.099981 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.099869 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0215057e-c05f-4735-8a28-d99c0cc5969f" containerName="istio-proxy" Jul 29 20:13:46.099981 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.099874 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0215057e-c05f-4735-8a28-d99c0cc5969f" containerName="istio-proxy" Jul 29 20:13:46.099981 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.099880 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="32f56675-5fac-4c59-9978-5eaae24be6bf" containerName="istio-proxy" Jul 29 20:13:46.103361 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.103346 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a60880-hqfss" Jul 29 20:13:46.105521 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.105493 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hq9l2\"" Jul 29 20:13:46.111299 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.111192 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a60880-hqfss"] Jul 29 20:13:46.218592 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.218554 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e036580-da5f-4fbc-b463-88735a4b9ce6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a60880-hqfss\" (UID: \"7e036580-da5f-4fbc-b463-88735a4b9ce6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a60880-hqfss" Jul 29 20:13:46.320029 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.319987 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e036580-da5f-4fbc-b463-88735a4b9ce6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a60880-hqfss\" (UID: \"7e036580-da5f-4fbc-b463-88735a4b9ce6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a60880-hqfss" Jul 29 20:13:46.320672 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.320651 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e036580-da5f-4fbc-b463-88735a4b9ce6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a60880-hqfss\" (UID: \"7e036580-da5f-4fbc-b463-88735a4b9ce6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a60880-hqfss" Jul 29 20:13:46.416739 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.416709 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a60880-hqfss" Jul 29 20:13:46.567746 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.567719 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a60880-hqfss"] Jul 29 20:13:46.569829 ip-10-0-136-162 kubenswrapper[2574]: W0729 20:13:46.569804 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e036580_da5f_4fbc_b463_88735a4b9ce6.slice/crio-a3df6bd053e418f76e33e0327fd1967e34450673361c939c0e6b786a75585692 WatchSource:0}: Error finding container a3df6bd053e418f76e33e0327fd1967e34450673361c939c0e6b786a75585692: Status 404 returned error can't find the container with id a3df6bd053e418f76e33e0327fd1967e34450673361c939c0e6b786a75585692 Jul 29 20:13:46.653458 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:46.653425 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a60880-hqfss" event={"ID":"7e036580-da5f-4fbc-b463-88735a4b9ce6","Type":"ContainerStarted","Data":"a3df6bd053e418f76e33e0327fd1967e34450673361c939c0e6b786a75585692"} Jul 29 20:13:47.660711 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:47.660671 2574 generic.go:356] "Generic (PLEG): container finished" podID="7e036580-da5f-4fbc-b463-88735a4b9ce6" containerID="ba68d1400acc865fc2dff945085aa98b9f8f2f304a01f645238df7c2a5658b68" exitCode=0 Jul 29 20:13:47.661159 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:47.660760 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a60880-hqfss" event={"ID":"7e036580-da5f-4fbc-b463-88735a4b9ce6","Type":"ContainerDied","Data":"ba68d1400acc865fc2dff945085aa98b9f8f2f304a01f645238df7c2a5658b68"} Jul 29 20:13:48.801017 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:48.800993 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a60880-hqfss" Jul 29 20:13:48.945883 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:48.945808 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e036580-da5f-4fbc-b463-88735a4b9ce6-maas-api-service-ca\") pod \"7e036580-da5f-4fbc-b463-88735a4b9ce6\" (UID: \"7e036580-da5f-4fbc-b463-88735a4b9ce6\") " Jul 29 20:13:48.946152 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:48.946130 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e036580-da5f-4fbc-b463-88735a4b9ce6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7e036580-da5f-4fbc-b463-88735a4b9ce6" (UID: "7e036580-da5f-4fbc-b463-88735a4b9ce6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 20:13:49.046426 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:49.046390 2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e036580-da5f-4fbc-b463-88735a4b9ce6-maas-api-service-ca\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:13:49.673631 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:49.673595 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a60880-hqfss" event={"ID":"7e036580-da5f-4fbc-b463-88735a4b9ce6","Type":"ContainerDied","Data":"a3df6bd053e418f76e33e0327fd1967e34450673361c939c0e6b786a75585692"} Jul 29 20:13:49.673631 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:49.673628 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a60880-hqfss" Jul 29 20:13:49.673848 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:49.673651 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3df6bd053e418f76e33e0327fd1967e34450673361c939c0e6b786a75585692" Jul 29 20:13:56.552760 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:56.552730 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:56.622120 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:56.622088 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:56.724859 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:56.724826 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:56.741015 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:56.740984 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a60880-hqfss"] Jul 29 20:13:56.748832 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:56.748806 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a60880-hqfss"] Jul 29 20:13:56.782979 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:56.782950 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:57.089094 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:57.089062 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:13:58.733920 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:13:58.733883 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e036580-da5f-4fbc-b463-88735a4b9ce6" path="/var/lib/kubelet/pods/7e036580-da5f-4fbc-b463-88735a4b9ce6/volumes" Jul 29 20:14:02.899166 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:02.899135 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:14:03.681031 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:03.680996 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:14:03.790438 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:03.790405 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:14:03.941882 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:03.941796 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:14:04.247951 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:04.247849 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:14:14.849018 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:14.848986 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:14:15.014593 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:15.014558 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:14:15.083543 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:15.083498 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:14:15.155997 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:15.155962 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:14:15.533267 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:15.533187 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:14:22.098278 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:22.098247 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:14:22.159768 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:22.159736 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:14:22.366482 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:22.366399 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2"] Jul 29 20:14:22.366663 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:22.366641 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" podUID="6efb1ae9-826e-4241-875d-4aebc9400d63" containerName="istio-proxy" containerID="cri-o://9f1c4f7be86d20ee20de790d35b87b5638219f2726c3c75d719a1dd2a4ccf787" gracePeriod=30 Jul 29 20:14:22.374861 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:22.374838 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:14:22.583401 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:22.583367 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:14:22.966960 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:22.966932 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5555b64fcc-49vwq_76767554-bb62-40ee-8657-fa96d6279eff/authorino/0.log" Jul 29 20:14:27.624722 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.624699 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 20:14:27.720064 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.720033 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-podinfo\") pod \"6efb1ae9-826e-4241-875d-4aebc9400d63\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " Jul 29 20:14:27.720254 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.720079 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-workload-socket\") pod \"6efb1ae9-826e-4241-875d-4aebc9400d63\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " Jul 29 20:14:27.720254 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.720118 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-data\") pod \"6efb1ae9-826e-4241-875d-4aebc9400d63\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " Jul 29 20:14:27.720254 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.720141 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m8q9\" (UniqueName: \"kubernetes.io/projected/6efb1ae9-826e-4241-875d-4aebc9400d63-kube-api-access-5m8q9\") pod \"6efb1ae9-826e-4241-875d-4aebc9400d63\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " Jul 29 20:14:27.720254 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.720196 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6efb1ae9-826e-4241-875d-4aebc9400d63-istiod-ca-cert\") pod \"6efb1ae9-826e-4241-875d-4aebc9400d63\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " Jul 29 20:14:27.720254 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.720220 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-workload-certs\") pod \"6efb1ae9-826e-4241-875d-4aebc9400d63\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " Jul 29 20:14:27.720551 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.720297 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-token\") pod \"6efb1ae9-826e-4241-875d-4aebc9400d63\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " Jul 29 20:14:27.720551 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.720313 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-credential-socket\") pod \"6efb1ae9-826e-4241-875d-4aebc9400d63\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " Jul 29 20:14:27.720551 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.720328 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-envoy\") pod \"6efb1ae9-826e-4241-875d-4aebc9400d63\" (UID: \"6efb1ae9-826e-4241-875d-4aebc9400d63\") " Jul 29 20:14:27.720551 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.720471 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6efb1ae9-826e-4241-875d-4aebc9400d63" (UID: "6efb1ae9-826e-4241-875d-4aebc9400d63"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:14:27.720764 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.720660 2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:14:27.720764 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.720675 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6efb1ae9-826e-4241-875d-4aebc9400d63" (UID: "6efb1ae9-826e-4241-875d-4aebc9400d63"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:14:27.720883 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.720851 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6efb1ae9-826e-4241-875d-4aebc9400d63" (UID: "6efb1ae9-826e-4241-875d-4aebc9400d63"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:14:27.720883 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.720869 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6efb1ae9-826e-4241-875d-4aebc9400d63-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6efb1ae9-826e-4241-875d-4aebc9400d63" (UID: "6efb1ae9-826e-4241-875d-4aebc9400d63"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 20:14:27.721205 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.721185 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-data" (OuterVolumeSpecName: "istio-data") pod "6efb1ae9-826e-4241-875d-4aebc9400d63" (UID: "6efb1ae9-826e-4241-875d-4aebc9400d63"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:14:27.722853 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.722829 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6efb1ae9-826e-4241-875d-4aebc9400d63" (UID: "6efb1ae9-826e-4241-875d-4aebc9400d63"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 29 20:14:27.722966 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.722866 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6efb1ae9-826e-4241-875d-4aebc9400d63-kube-api-access-5m8q9" (OuterVolumeSpecName: "kube-api-access-5m8q9") pod "6efb1ae9-826e-4241-875d-4aebc9400d63" (UID: "6efb1ae9-826e-4241-875d-4aebc9400d63"). InnerVolumeSpecName "kube-api-access-5m8q9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:14:27.722966 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.722937 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6efb1ae9-826e-4241-875d-4aebc9400d63" (UID: "6efb1ae9-826e-4241-875d-4aebc9400d63"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 20:14:27.722966 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.722945 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-token" (OuterVolumeSpecName: "istio-token") pod "6efb1ae9-826e-4241-875d-4aebc9400d63" (UID: "6efb1ae9-826e-4241-875d-4aebc9400d63"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 20:14:27.821929 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.821894 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:14:27.821929 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.821923 2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:14:27.821929 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.821938 2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:14:27.822167 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.821950 2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:14:27.822167 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.821961 2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:14:27.822167 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.821972 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m8q9\" (UniqueName: \"kubernetes.io/projected/6efb1ae9-826e-4241-875d-4aebc9400d63-kube-api-access-5m8q9\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:14:27.822167 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.821983 2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6efb1ae9-826e-4241-875d-4aebc9400d63-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:14:27.822167 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.821994 2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6efb1ae9-826e-4241-875d-4aebc9400d63-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\"" Jul 29 20:14:27.889190 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.889159 2574 generic.go:356] "Generic (PLEG): container finished" podID="6efb1ae9-826e-4241-875d-4aebc9400d63" containerID="9f1c4f7be86d20ee20de790d35b87b5638219f2726c3c75d719a1dd2a4ccf787" exitCode=0 Jul 29 20:14:27.889330 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.889209 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" Jul 29 20:14:27.889330 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.889244 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" event={"ID":"6efb1ae9-826e-4241-875d-4aebc9400d63","Type":"ContainerDied","Data":"9f1c4f7be86d20ee20de790d35b87b5638219f2726c3c75d719a1dd2a4ccf787"} Jul 29 20:14:27.889330 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.889298 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2" event={"ID":"6efb1ae9-826e-4241-875d-4aebc9400d63","Type":"ContainerDied","Data":"7dc4df47960061bdecde385d629b5c7424e3ce35e687121937027bdf9dd65e6e"} Jul 29 20:14:27.889330 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.889324 2574 scope.go:117] "RemoveContainer" containerID="9f1c4f7be86d20ee20de790d35b87b5638219f2726c3c75d719a1dd2a4ccf787" Jul 29 20:14:27.898837 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.898820 2574 scope.go:117] "RemoveContainer" containerID="5acd8622a8df68bafb8f4c4e3b18699c2dc46cc32dc430611216d2d3d3ef75d2" Jul 29 20:14:27.907071 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.907051 2574 scope.go:117] "RemoveContainer" containerID="9f1c4f7be86d20ee20de790d35b87b5638219f2726c3c75d719a1dd2a4ccf787" Jul 29 20:14:27.907357 ip-10-0-136-162 kubenswrapper[2574]: E0729 20:14:27.907337 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f1c4f7be86d20ee20de790d35b87b5638219f2726c3c75d719a1dd2a4ccf787\": container with ID starting with 9f1c4f7be86d20ee20de790d35b87b5638219f2726c3c75d719a1dd2a4ccf787 not found: ID does not exist" containerID="9f1c4f7be86d20ee20de790d35b87b5638219f2726c3c75d719a1dd2a4ccf787" Jul 29 20:14:27.907457 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.907370 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f1c4f7be86d20ee20de790d35b87b5638219f2726c3c75d719a1dd2a4ccf787"} err="failed to get container status \"9f1c4f7be86d20ee20de790d35b87b5638219f2726c3c75d719a1dd2a4ccf787\": rpc error: code = NotFound desc = could not find container \"9f1c4f7be86d20ee20de790d35b87b5638219f2726c3c75d719a1dd2a4ccf787\": container with ID starting with 9f1c4f7be86d20ee20de790d35b87b5638219f2726c3c75d719a1dd2a4ccf787 not found: ID does not exist" Jul 29 20:14:27.907457 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.907392 2574 scope.go:117] "RemoveContainer" containerID="5acd8622a8df68bafb8f4c4e3b18699c2dc46cc32dc430611216d2d3d3ef75d2" Jul 29 20:14:27.907693 ip-10-0-136-162 kubenswrapper[2574]: E0729 20:14:27.907676 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5acd8622a8df68bafb8f4c4e3b18699c2dc46cc32dc430611216d2d3d3ef75d2\": container with ID starting with 5acd8622a8df68bafb8f4c4e3b18699c2dc46cc32dc430611216d2d3d3ef75d2 not found: ID does not exist" containerID="5acd8622a8df68bafb8f4c4e3b18699c2dc46cc32dc430611216d2d3d3ef75d2" Jul 29 20:14:27.907740 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.907700 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5acd8622a8df68bafb8f4c4e3b18699c2dc46cc32dc430611216d2d3d3ef75d2"} err="failed to get container status \"5acd8622a8df68bafb8f4c4e3b18699c2dc46cc32dc430611216d2d3d3ef75d2\": rpc error: code = NotFound desc = could not find container \"5acd8622a8df68bafb8f4c4e3b18699c2dc46cc32dc430611216d2d3d3ef75d2\": container with ID starting with 5acd8622a8df68bafb8f4c4e3b18699c2dc46cc32dc430611216d2d3d3ef75d2 not found: ID does not exist" Jul 29 20:14:27.912649 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.912625 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2"] Jul 29 20:14:27.920079 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:27.920058 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-601aa9-openshift-default-567c59bb96-b8tj2"] Jul 29 20:14:28.734247 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:28.734213 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6efb1ae9-826e-4241-875d-4aebc9400d63" path="/var/lib/kubelet/pods/6efb1ae9-826e-4241-875d-4aebc9400d63/volumes" Jul 29 20:14:28.854079 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:28.854052 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-667b7bc75f-cqqx2_c930d9a3-9358-431a-a32a-792d58dfd8bb/manager/0.log" Jul 29 20:14:28.860588 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:28.860565 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-667b7bc75f-cqqx2_c930d9a3-9358-431a-a32a-792d58dfd8bb/copy-manifests/0.log" Jul 29 20:14:29.451557 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:29.451530 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7c7fbc67d6-k2crc_bbae48e6-54c2-4acb-ad45-3509bc8ad16a/maas-api/0.log" Jul 29 20:14:29.877179 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:29.877092 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-wkslr_b1719744-e248-4330-ab56-6c0a28652686/postgres/0.log" Jul 29 20:14:30.617100 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:30.617071 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv_27dab636-bc58-4414-b441-8d96611a44d8/util/0.log" Jul 29 20:14:30.623586 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:30.623555 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv_27dab636-bc58-4414-b441-8d96611a44d8/pull/0.log" Jul 29 20:14:30.630296 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:30.630270 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv_27dab636-bc58-4414-b441-8d96611a44d8/extract/0.log" Jul 29 20:14:30.732840 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:30.732816 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx_8b30f211-c488-453d-89bb-e814ebda2766/util/0.log" Jul 29 20:14:30.738132 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:30.738105 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx_8b30f211-c488-453d-89bb-e814ebda2766/pull/0.log" Jul 29 20:14:30.743475 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:30.743457 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx_8b30f211-c488-453d-89bb-e814ebda2766/extract/0.log" Jul 29 20:14:30.849067 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:30.849035 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb_35289aa7-bf76-4ec3-8a87-b60fbbc9abb8/util/0.log" Jul 29 20:14:30.861738 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:30.861711 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb_35289aa7-bf76-4ec3-8a87-b60fbbc9abb8/pull/0.log" Jul 29 20:14:30.868452 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:30.868394 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb_35289aa7-bf76-4ec3-8a87-b60fbbc9abb8/extract/0.log" Jul 29 20:14:30.973098 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:30.973071 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb_8d56327e-9d90-45ef-93ba-e927ccbef7b2/util/0.log" Jul 29 20:14:30.978689 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:30.978670 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb_8d56327e-9d90-45ef-93ba-e927ccbef7b2/pull/0.log" Jul 29 20:14:30.984826 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:30.984809 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb_8d56327e-9d90-45ef-93ba-e927ccbef7b2/extract/0.log" Jul 29 20:14:31.099572 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:31.099545 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5555b64fcc-49vwq_76767554-bb62-40ee-8657-fa96d6279eff/authorino/0.log" Jul 29 20:14:31.346231 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:31.346201 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cksr8_8a416e32-906e-498f-87c8-e09c583acb16/manager/0.log" Jul 29 20:14:31.566380 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:31.566353 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-s4kdt_3623f182-5cd8-45f6-be59-3ef1aed2c2ad/registry-server/0.log" Jul 29 20:14:31.910617 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:31.910583 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6rkq9_08950801-eef4-493d-8533-d0ded0223733/manager/0.log" Jul 29 20:14:32.243584 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:32.243498 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp_d403865e-797b-49a6-b37c-1697c377ed77/istio-proxy/0.log" Jul 29 20:14:32.681390 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:32.681354 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p4wng_25fa8c35-be85-4183-9249-b06576f2ed0e/istio-proxy/1.log" Jul 29 20:14:32.900127 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:32.900096 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-df4hx_1ece25a0-84ea-485c-b5e2-e69e7e2987c8/payload-processing/0.log" Jul 29 20:14:33.006921 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:33.006837 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bb4465977-m9lgt_c6ca279a-a264-44bc-b405-6ab87672b286/router/0.log" Jul 29 20:14:33.336356 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:33.336262 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-dm7zc_8d85d7bf-1d92-4637-b128-a4e1bbd0e5be/main/0.log" Jul 29 20:14:33.556312 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:33.556282 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-bkgqh_03c80d2b-e5d4-4705-a518-6e7763f49fa1/main/0.log" Jul 29 20:14:33.775917 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:33.775888 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-mlxkh_6c8d1376-4f86-47ae-a853-ed616e0137c2/main/0.log" Jul 29 20:14:38.835460 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:38.835426 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:14:38.892017 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:38.891992 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" limit=1024 Jul 29 20:14:41.727635 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:41.727608 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7plmd_9521677d-7019-45f6-8e84-472a86d51c00/global-pull-secret-syncer/0.log" Jul 29 20:14:41.863422 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:41.863392 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7s2ld_9e56c811-fd8f-47a4-a92c-44bd94993dce/konnectivity-agent/0.log" Jul 29 20:14:42.001056 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:42.000985 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-162.ec2.internal_63bcc45c5ec23bde54a6545b8958739b/haproxy/0.log" Jul 29 20:14:46.209899 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:46.209869 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv_27dab636-bc58-4414-b441-8d96611a44d8/extract/0.log" Jul 29 20:14:46.236982 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:46.236957 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv_27dab636-bc58-4414-b441-8d96611a44d8/util/0.log" Jul 29 20:14:46.257489 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:46.257464 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n2wtv_27dab636-bc58-4414-b441-8d96611a44d8/pull/0.log" Jul 29 20:14:46.284068 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:46.284046 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx_8b30f211-c488-453d-89bb-e814ebda2766/extract/0.log" Jul 29 20:14:46.304110 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:46.304084 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx_8b30f211-c488-453d-89bb-e814ebda2766/util/0.log" Jul 29 20:14:46.328349 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:46.328327 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08xlpx_8b30f211-c488-453d-89bb-e814ebda2766/pull/0.log" Jul 29 20:14:46.357154 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:46.357130 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb_35289aa7-bf76-4ec3-8a87-b60fbbc9abb8/extract/0.log" Jul 29 20:14:46.379876 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:46.379852 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb_35289aa7-bf76-4ec3-8a87-b60fbbc9abb8/util/0.log" Jul 29 20:14:46.417285 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:46.417263 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v5lnb_35289aa7-bf76-4ec3-8a87-b60fbbc9abb8/pull/0.log" Jul 29 20:14:46.452704 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:46.452681 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb_8d56327e-9d90-45ef-93ba-e927ccbef7b2/extract/0.log" Jul 29 20:14:46.478378 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:46.478311 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb_8d56327e-9d90-45ef-93ba-e927ccbef7b2/util/0.log" Jul 29 20:14:46.507084 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:46.507067 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1547jb_8d56327e-9d90-45ef-93ba-e927ccbef7b2/pull/0.log" Jul 29 20:14:46.825230 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:46.825154 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5555b64fcc-49vwq_76767554-bb62-40ee-8657-fa96d6279eff/authorino/0.log" Jul 29 20:14:46.907284 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:46.907251 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cksr8_8a416e32-906e-498f-87c8-e09c583acb16/manager/0.log" Jul 29 20:14:46.989202 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:46.989175 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-s4kdt_3623f182-5cd8-45f6-be59-3ef1aed2c2ad/registry-server/0.log" Jul 29 20:14:47.316724 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:47.316695 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6rkq9_08950801-eef4-493d-8533-d0ded0223733/manager/0.log" Jul 29 20:14:49.217090 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:49.217062 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-q7tkb_a7ee0f3b-4ae1-4005-a5ae-cca1527207aa/cluster-monitoring-operator/0.log" Jul 29 20:14:49.417155 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:49.417078 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c78qc_f771a0b6-5756-46e1-91ee-ee418a8d4d30/node-exporter/0.log" Jul 29 20:14:49.439604 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:49.439579 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c78qc_f771a0b6-5756-46e1-91ee-ee418a8d4d30/kube-rbac-proxy/0.log" Jul 29 20:14:49.465364 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:49.465343 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c78qc_f771a0b6-5756-46e1-91ee-ee418a8d4d30/init-textfile/0.log" Jul 29 20:14:50.030767 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:50.030738 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56c78d9db4-cp2bf_38047098-efbd-4c35-b876-dafe7517d3c5/telemeter-client/0.log" Jul 29 20:14:50.057593 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:50.057568 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56c78d9db4-cp2bf_38047098-efbd-4c35-b876-dafe7517d3c5/reload/0.log" Jul 29 20:14:50.078635 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:50.078613 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56c78d9db4-cp2bf_38047098-efbd-4c35-b876-dafe7517d3c5/kube-rbac-proxy/0.log" Jul 29 20:14:51.686203 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.686169 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk"] Jul 29 20:14:51.686607 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.686575 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6efb1ae9-826e-4241-875d-4aebc9400d63" containerName="istio-proxy" Jul 29 20:14:51.686607 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.686587 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6efb1ae9-826e-4241-875d-4aebc9400d63" containerName="istio-proxy" Jul 29 20:14:51.686607 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.686606 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e036580-da5f-4fbc-b463-88735a4b9ce6" containerName="revoke-keys" Jul 29 20:14:51.686716 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.686613 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e036580-da5f-4fbc-b463-88735a4b9ce6" containerName="revoke-keys" Jul 29 20:14:51.686716 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.686625 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0215057e-c05f-4735-8a28-d99c0cc5969f" containerName="istio-proxy" Jul 29 20:14:51.686716 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.686631 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0215057e-c05f-4735-8a28-d99c0cc5969f" containerName="istio-proxy" Jul 29 20:14:51.686813 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.686718 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e036580-da5f-4fbc-b463-88735a4b9ce6" containerName="revoke-keys" Jul 29 20:14:51.686813 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.686727 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6efb1ae9-826e-4241-875d-4aebc9400d63" containerName="istio-proxy" Jul 29 20:14:51.691109 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.691090 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:51.692709 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.692690 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ttn7v\"/\"kube-root-ca.crt\"" Jul 29 20:14:51.693120 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.693104 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ttn7v\"/\"openshift-service-ca.crt\"" Jul 29 20:14:51.693205 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.693107 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ttn7v\"/\"default-dockercfg-4bzhx\"" Jul 29 20:14:51.698256 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.698232 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk"] Jul 29 20:14:51.734822 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.734784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgwk2\" (UniqueName: \"kubernetes.io/projected/37350284-3529-4777-9d09-73008580d309-kube-api-access-mgwk2\") pod \"perf-node-gather-daemonset-spbvk\" (UID: \"37350284-3529-4777-9d09-73008580d309\") " pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:51.734956 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.734838 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37350284-3529-4777-9d09-73008580d309-proc\") pod \"perf-node-gather-daemonset-spbvk\" (UID: \"37350284-3529-4777-9d09-73008580d309\") " pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:51.734956 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.734876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37350284-3529-4777-9d09-73008580d309-podres\") pod \"perf-node-gather-daemonset-spbvk\" (UID: \"37350284-3529-4777-9d09-73008580d309\") " pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:51.734956 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.734897 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37350284-3529-4777-9d09-73008580d309-sys\") pod \"perf-node-gather-daemonset-spbvk\" (UID: \"37350284-3529-4777-9d09-73008580d309\") " pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:51.734956 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.734911 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37350284-3529-4777-9d09-73008580d309-lib-modules\") pod \"perf-node-gather-daemonset-spbvk\" (UID: \"37350284-3529-4777-9d09-73008580d309\") " pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:51.836151 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.836117 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37350284-3529-4777-9d09-73008580d309-podres\") pod \"perf-node-gather-daemonset-spbvk\" (UID: \"37350284-3529-4777-9d09-73008580d309\") " pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:51.836312 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.836159 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37350284-3529-4777-9d09-73008580d309-sys\") pod \"perf-node-gather-daemonset-spbvk\" (UID: \"37350284-3529-4777-9d09-73008580d309\") " pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:51.836312 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.836176 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37350284-3529-4777-9d09-73008580d309-lib-modules\") pod \"perf-node-gather-daemonset-spbvk\" (UID: \"37350284-3529-4777-9d09-73008580d309\") " pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:51.836312 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.836235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgwk2\" (UniqueName: \"kubernetes.io/projected/37350284-3529-4777-9d09-73008580d309-kube-api-access-mgwk2\") pod \"perf-node-gather-daemonset-spbvk\" (UID: \"37350284-3529-4777-9d09-73008580d309\") " pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:51.836312 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.836295 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37350284-3529-4777-9d09-73008580d309-proc\") pod \"perf-node-gather-daemonset-spbvk\" (UID: \"37350284-3529-4777-9d09-73008580d309\") " pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:51.836454 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.836300 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37350284-3529-4777-9d09-73008580d309-podres\") pod \"perf-node-gather-daemonset-spbvk\" (UID: \"37350284-3529-4777-9d09-73008580d309\") " pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:51.836454 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.836326 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37350284-3529-4777-9d09-73008580d309-sys\") pod \"perf-node-gather-daemonset-spbvk\" (UID: \"37350284-3529-4777-9d09-73008580d309\") " pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:51.836454 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.836374 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37350284-3529-4777-9d09-73008580d309-proc\") pod \"perf-node-gather-daemonset-spbvk\" (UID: \"37350284-3529-4777-9d09-73008580d309\") " pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:51.836454 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.836412 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37350284-3529-4777-9d09-73008580d309-lib-modules\") pod \"perf-node-gather-daemonset-spbvk\" (UID: \"37350284-3529-4777-9d09-73008580d309\") " pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:51.843800 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:51.843781 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgwk2\" (UniqueName: \"kubernetes.io/projected/37350284-3529-4777-9d09-73008580d309-kube-api-access-mgwk2\") pod \"perf-node-gather-daemonset-spbvk\" (UID: \"37350284-3529-4777-9d09-73008580d309\") " pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:52.004729 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:52.004642 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:52.109317 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:52.109291 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/1.log" Jul 29 20:14:52.117183 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:52.117151 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q5gv2_4f708385-526b-408f-98fe-03b81ef5fb6b/console-operator/2.log" Jul 29 20:14:52.162995 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:52.162970 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk"] Jul 29 20:14:52.164678 ip-10-0-136-162 kubenswrapper[2574]: W0729 20:14:52.164654 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod37350284_3529_4777_9d09_73008580d309.slice/crio-677134e14e8fae0784e1fe7809d48888d8f2e3dc866fa5e8d1fc32fd676525de WatchSource:0}: Error finding container 677134e14e8fae0784e1fe7809d48888d8f2e3dc866fa5e8d1fc32fd676525de: Status 404 returned error can't find the container with id 677134e14e8fae0784e1fe7809d48888d8f2e3dc866fa5e8d1fc32fd676525de Jul 29 20:14:52.702394 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:52.702362 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-grl5c_5c69d0c5-b5bd-4bf5-9c22-70c9d5bce5e7/download-server/0.log" Jul 29 20:14:53.027330 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:53.027246 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" event={"ID":"37350284-3529-4777-9d09-73008580d309","Type":"ContainerStarted","Data":"5a1ddfad78e45d96ce8b117f79478cbfa48f783ce7f920511a494f729ea9d985"} Jul 29 20:14:53.027330 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:53.027304 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" event={"ID":"37350284-3529-4777-9d09-73008580d309","Type":"ContainerStarted","Data":"677134e14e8fae0784e1fe7809d48888d8f2e3dc866fa5e8d1fc32fd676525de"} Jul 29 20:14:53.027614 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:53.027382 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:14:53.046230 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:53.046184 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" podStartSLOduration=2.046170844 podStartE2EDuration="2.046170844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 20:14:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 20:14:53.04423069 +0000 UTC m=+3482.932537937" watchObservedRunningTime="2026-07-29 20:14:53.046170844 +0000 UTC m=+3482.934478089" Jul 29 20:14:53.267911 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:53.267863 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-sx56s_33871ba5-4d43-4229-a3f6-895af4883834/volume-data-source-validator/0.log" Jul 29 20:14:54.425154 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:54.425122 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lzdtw_b46bb66d-8a39-4f0a-9758-25fc8b85804a/dns/0.log" Jul 29 20:14:54.442016 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:54.441997 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lzdtw_b46bb66d-8a39-4f0a-9758-25fc8b85804a/kube-rbac-proxy/0.log" Jul 29 20:14:54.538705 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:54.538664 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m4qwh_44e454bf-8721-4247-b10c-9eb4f1d850b1/dns-node-resolver/0.log" Jul 29 20:14:55.098657 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:55.098623 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5wg8l_0fb4252c-4795-40b7-8f5e-e1f540f9ec8b/node-ca/0.log" Jul 29 20:14:56.090177 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:56.090142 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp_d403865e-797b-49a6-b37c-1697c377ed77/istio-proxy/0.log" Jul 29 20:14:56.318332 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:56.318296 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p4wng_25fa8c35-be85-4183-9249-b06576f2ed0e/istio-proxy/0.log" Jul 29 20:14:56.347126 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:56.347031 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p4wng_25fa8c35-be85-4183-9249-b06576f2ed0e/istio-proxy/1.log" Jul 29 20:14:56.409086 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:56.409059 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-df4hx_1ece25a0-84ea-485c-b5e2-e69e7e2987c8/payload-processing/0.log" Jul 29 20:14:56.430681 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:56.430645 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bb4465977-m9lgt_c6ca279a-a264-44bc-b405-6ab87672b286/router/0.log" Jul 29 20:14:57.244705 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:57.244680 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w9tlj_71ad3104-e1e8-44a1-91c2-7b877e8f66c1/serve-healthcheck-canary/0.log" Jul 29 20:14:57.710887 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:57.710855 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-8hgcl_bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78/insights-operator/0.log" Jul 29 20:14:57.711967 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:57.711948 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-8hgcl_bcda0b0e-7f9c-4b0d-8ec6-fe4a932a4d78/insights-operator/1.log" Jul 29 20:14:57.885952 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:57.885923 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vvjdl_d147b8c7-251a-4c9d-aef7-35016719e787/kube-rbac-proxy/0.log" Jul 29 20:14:57.909066 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:57.909042 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vvjdl_d147b8c7-251a-4c9d-aef7-35016719e787/exporter/0.log" Jul 29 20:14:57.933789 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:57.933768 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vvjdl_d147b8c7-251a-4c9d-aef7-35016719e787/extractor/0.log" Jul 29 20:14:59.043273 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:14:59.043243 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ttn7v/perf-node-gather-daemonset-spbvk" Jul 29 20:15:00.707624 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:00.707598 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-667b7bc75f-cqqx2_c930d9a3-9358-431a-a32a-792d58dfd8bb/manager/0.log" Jul 29 20:15:00.735165 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:00.735135 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-667b7bc75f-cqqx2_c930d9a3-9358-431a-a32a-792d58dfd8bb/copy-manifests/0.log" Jul 29 20:15:02.264616 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:02.264584 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-848988bfdc-7pwqn_d2d80e96-d941-471a-a082-1de851811f0f/manager/0.log" Jul 29 20:15:02.280222 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:02.280195 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp_d403865e-797b-49a6-b37c-1697c377ed77/istio-proxy/0.log" Jul 29 20:15:02.465034 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:02.464989 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p4wng_25fa8c35-be85-4183-9249-b06576f2ed0e/istio-proxy/0.log" Jul 29 20:15:02.493307 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:02.493281 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p4wng_25fa8c35-be85-4183-9249-b06576f2ed0e/istio-proxy/1.log" Jul 29 20:15:02.539410 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:02.539337 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-df4hx_1ece25a0-84ea-485c-b5e2-e69e7e2987c8/payload-processing/0.log" Jul 29 20:15:02.554154 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:02.554129 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bb4465977-m9lgt_c6ca279a-a264-44bc-b405-6ab87672b286/router/0.log" Jul 29 20:15:03.933144 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:03.933117 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-qvlxp_d403865e-797b-49a6-b37c-1697c377ed77/istio-proxy/0.log" Jul 29 20:15:04.127272 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:04.127242 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p4wng_25fa8c35-be85-4183-9249-b06576f2ed0e/istio-proxy/0.log" Jul 29 20:15:04.152658 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:04.152630 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-p4wng_25fa8c35-be85-4183-9249-b06576f2ed0e/istio-proxy/1.log" Jul 29 20:15:04.205775 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:04.205705 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-df4hx_1ece25a0-84ea-485c-b5e2-e69e7e2987c8/payload-processing/0.log" Jul 29 20:15:04.222287 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:04.222266 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bb4465977-m9lgt_c6ca279a-a264-44bc-b405-6ab87672b286/router/0.log" Jul 29 20:15:07.250324 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:07.250296 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-wqhst_f88da9c8-4deb-4773-b937-31cbbfab0d33/migrator/0.log" Jul 29 20:15:07.267170 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:07.267141 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-wqhst_f88da9c8-4deb-4773-b937-31cbbfab0d33/graceful-termination/0.log" Jul 29 20:15:07.647949 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:07.647917 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v_00daf99c-cd3c-4ce7-907c-d03b8d0f7325/kube-storage-version-migrator-operator/1.log" Jul 29 20:15:07.648917 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:07.648901 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-lds6v_00daf99c-cd3c-4ce7-907c-d03b8d0f7325/kube-storage-version-migrator-operator/0.log" Jul 29 20:15:08.831171 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:08.831143 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6c27_08faa4de-239e-43a9-a111-f9d490a0710d/kube-multus-additional-cni-plugins/0.log" Jul 29 20:15:08.860589 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:08.860561 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6c27_08faa4de-239e-43a9-a111-f9d490a0710d/egress-router-binary-copy/0.log" Jul 29 20:15:08.880406 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:08.880388 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6c27_08faa4de-239e-43a9-a111-f9d490a0710d/cni-plugins/0.log" Jul 29 20:15:08.902050 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:08.902026 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6c27_08faa4de-239e-43a9-a111-f9d490a0710d/bond-cni-plugin/0.log" Jul 29 20:15:08.925331 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:08.925303 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6c27_08faa4de-239e-43a9-a111-f9d490a0710d/routeoverride-cni/0.log" Jul 29 20:15:08.946588 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:08.946568 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6c27_08faa4de-239e-43a9-a111-f9d490a0710d/whereabouts-cni-bincopy/0.log" Jul 29 20:15:08.967471 ip-10-0-136-162 kubenswrapper[2574]: I0729 20:15:08.967445 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6c27_08faa4de-239e-43a9-a111-f9d490a0710d/whereabouts-cni/0.log"