Jul 24 14:31:44.316843 ip-10-0-142-64 systemd[1]: Starting Kubernetes Kubelet... Jul 24 14:31:44.763350 ip-10-0-142-64 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 14:31:44.763350 ip-10-0-142-64 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 14:31:44.763350 ip-10-0-142-64 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 14:31:44.763350 ip-10-0-142-64 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 14:31:44.763350 ip-10-0-142-64 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 14:31:44.764500 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.764413 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 14:31:44.769808 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769789 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:31:44.769808 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769804 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:31:44.769808 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769807 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:31:44.769808 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769811 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:31:44.769808 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769814 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769818 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769821 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769824 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769827 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769830 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769833 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769835 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769838 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769840 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769843 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769846 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769849 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769852 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769854 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769857 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769859 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769862 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769864 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769867 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:31:44.769992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769869 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769872 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769874 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769877 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769879 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769883 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769888 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769891 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769894 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769896 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769899 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769902 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769904 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769907 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769910 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769913 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769915 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769918 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769921 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769923 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:31:44.770470 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769927 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769929 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769932 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769935 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769937 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769941 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769944 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769946 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769949 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769951 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769954 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769957 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769959 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769961 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769964 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769966 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769969 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769972 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769975 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769977 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:31:44.771055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769981 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769983 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769986 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769988 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769991 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769993 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.769997 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770000 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770002 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770005 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770009 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770011 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770014 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770017 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770019 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770021 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770024 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770026 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770029 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:31:44.771577 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770033 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770036 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770039 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770042 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770045 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770047 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770050 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770052 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770055 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770057 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770061 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770065 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770067 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770070 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770073 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.770076 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771610 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771622 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771627 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771630 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:31:44.772037 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771633 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771637 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771639 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771642 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771645 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771649 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771653 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771655 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771658 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771661 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771664 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771666 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771669 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771671 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771674 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771677 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771679 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771682 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771685 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771688 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:31:44.772541 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771690 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771693 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771696 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771698 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771701 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771703 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771706 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771709 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771711 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771715 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771718 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771721 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771723 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771726 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771729 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771733 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771737 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771740 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771743 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771746 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:31:44.773041 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771749 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771752 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771754 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771757 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771760 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771762 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771765 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771767 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771770 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771773 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771777 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771780 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771783 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771785 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771789 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771792 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771794 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771797 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771799 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:31:44.773597 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771802 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771804 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771808 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771811 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771814 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771817 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771819 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771822 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771824 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771827 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771829 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771832 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771834 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771837 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771840 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771842 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771845 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771847 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771850 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771853 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:31:44.774072 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771855 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771858 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771860 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771863 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771866 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771869 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771871 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771874 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771876 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771879 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771882 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771885 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771887 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771890 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771893 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.771896 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772271 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772276 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772278 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:31:44.774662 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772281 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772284 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772287 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772289 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772292 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772294 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772297 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772299 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772302 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772305 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772307 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772310 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772313 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772315 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772318 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772320 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772322 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772325 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772327 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772330 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772333 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:31:44.775409 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772336 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772338 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772341 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772343 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772346 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772348 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772353 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772357 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772362 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772365 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772368 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772371 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772374 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772377 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772379 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772382 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772384 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772387 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772390 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:31:44.775950 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772393 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772395 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772398 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772400 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772403 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772406 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772408 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772411 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772413 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772416 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772419 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772421 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772424 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772426 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772429 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772431 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772434 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772436 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772439 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772442 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:31:44.776471 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772445 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772448 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772451 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772454 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772456 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772459 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772461 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772464 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772466 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772469 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772471 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772474 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772476 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772479 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772481 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772484 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772487 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772489 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772492 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772494 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:31:44.777185 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772497 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772499 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772502 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772507 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772511 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772514 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772517 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772520 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772523 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772525 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772548 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772553 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772556 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772559 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772561 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.772565 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772650 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772660 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772678 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772686 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 14:31:44.777718 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772690 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772694 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772698 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772702 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772706 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772709 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772712 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772716 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772719 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772722 2581 flags.go:64] FLAG: --cgroup-root="" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772725 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772728 2581 flags.go:64] FLAG: --client-ca-file="" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772731 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772735 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772739 2581 flags.go:64] FLAG: --cluster-domain="" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772742 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772745 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772748 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772751 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772754 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772760 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772763 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772766 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772769 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 24 14:31:44.778251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772772 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772775 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772778 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772781 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772786 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772789 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772792 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772795 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772798 2581 flags.go:64] FLAG: --enable-server="true" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772801 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772806 2581 flags.go:64] FLAG: --event-burst="100" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772809 2581 flags.go:64] FLAG: --event-qps="50" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772812 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772815 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772818 2581 flags.go:64] FLAG: --eviction-hard="" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772822 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772825 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772828 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772831 2581 flags.go:64] FLAG: --eviction-soft="" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772834 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772836 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772839 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772843 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772845 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772848 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 14:31:44.778886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772851 2581 flags.go:64] FLAG: --feature-gates="" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772855 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772858 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772862 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772865 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772869 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772872 2581 flags.go:64] FLAG: --help="false" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772875 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-142-64.ec2.internal" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772878 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772881 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772884 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772887 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772891 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772894 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772896 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772900 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772902 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772905 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772908 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772911 2581 flags.go:64] FLAG: --kube-reserved="" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772914 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772919 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772922 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772925 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 14:31:44.779577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772927 2581 flags.go:64] FLAG: --lock-file="" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772930 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772933 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772936 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772942 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772945 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772948 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772950 2581 flags.go:64] FLAG: --logging-format="text" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772953 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772956 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772959 2581 flags.go:64] FLAG: --manifest-url="" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772964 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772968 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772971 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772975 2581 flags.go:64] FLAG: --max-pods="110" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772978 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772981 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772984 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772987 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772990 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772993 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.772996 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773003 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773006 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773009 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 14:31:44.780173 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773012 2581 flags.go:64] FLAG: --pod-cidr="" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773015 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773021 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773023 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773028 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773031 2581 flags.go:64] FLAG: --port="10250" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773034 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773038 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06996cd890cd6c604" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773041 2581 flags.go:64] FLAG: --qos-reserved="" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773044 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773047 2581 flags.go:64] FLAG: --register-node="true" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773050 2581 flags.go:64] FLAG: --register-with-taints="" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773055 2581 flags.go:64] FLAG: --registry-burst="10" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773058 2581 flags.go:64] FLAG: --registry-qps="5" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773061 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773064 2581 flags.go:64] FLAG: --reserved-memory="" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773067 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773070 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773073 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773077 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773079 2581 flags.go:64] FLAG: --runonce="false" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773082 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773085 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773088 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773091 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 14:31:44.780847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773094 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773097 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773101 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773104 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773107 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773110 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773113 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773115 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773118 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773121 2581 flags.go:64] FLAG: --system-cgroups="" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773124 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773130 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773133 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773136 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773140 2581 flags.go:64] FLAG: --tls-min-version="" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773143 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773146 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773148 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773151 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773154 2581 flags.go:64] FLAG: --v="2" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773158 2581 flags.go:64] FLAG: --version="false" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773162 2581 flags.go:64] FLAG: --vmodule="" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773165 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773168 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773282 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:31:44.781568 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773285 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773288 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773291 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773293 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773296 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773299 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773301 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773304 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773307 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773309 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773312 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773314 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773317 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773320 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773323 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773325 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773328 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773330 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773334 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773337 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:31:44.782182 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773340 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773342 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773345 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773347 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773350 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773352 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773355 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773358 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773360 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773363 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773365 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773368 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773370 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773373 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773376 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773378 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773381 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773383 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773386 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:31:44.782695 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773388 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773391 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773393 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773396 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773398 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773401 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773404 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773406 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773408 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773411 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773415 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773420 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773423 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773426 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773429 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773431 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773434 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773437 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773439 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:31:44.783152 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773442 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773444 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773447 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773450 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773452 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773455 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773457 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773460 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773462 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773465 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773467 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773470 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773472 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773474 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773477 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773480 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773482 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773485 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773487 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773489 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:31:44.783665 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773492 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773495 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773497 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773500 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773513 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773516 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773518 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773522 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773525 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773540 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773543 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773546 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773550 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773554 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773557 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773560 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773563 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773566 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773568 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:31:44.784146 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.773572 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:31:44.784729 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.773582 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 14:31:44.784729 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.782845 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 14:31:44.784729 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.782866 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 14:31:44.784729 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.782884 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 14:31:44.784729 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.782890 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 14:31:44.784729 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782949 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:31:44.784729 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782954 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:31:44.784729 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782958 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:31:44.784729 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782960 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:31:44.784729 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782963 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:31:44.784729 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782966 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:31:44.784729 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782969 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:31:44.784729 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782972 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:31:44.784729 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782974 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:31:44.784729 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782977 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782980 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782983 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782985 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782988 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782991 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782994 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782996 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.782999 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783001 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783004 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783007 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783009 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783012 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783016 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783020 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783023 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783026 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783029 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783032 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:31:44.785108 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783036 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783039 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783042 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783046 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783048 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783051 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783054 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783058 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783062 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783064 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783067 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783070 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783073 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783075 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783078 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783081 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783083 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783086 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783089 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:31:44.785626 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783092 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783095 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783097 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783100 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783103 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783105 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783108 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783111 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783114 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783116 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783119 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783122 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783126 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783130 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783133 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783136 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783139 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783141 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783144 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:31:44.786086 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783147 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783150 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783152 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783155 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783157 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783160 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783163 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783166 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783169 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783171 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783174 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783177 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783180 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783183 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783186 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783188 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783191 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783194 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783196 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783199 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:31:44.786564 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783201 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:31:44.787085 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783204 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:31:44.787085 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783207 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:31:44.787085 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783209 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:31:44.787085 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783212 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:31:44.787085 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783215 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:31:44.787085 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783218 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:31:44.787085 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783220 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:31:44.787085 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783223 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:31:44.787085 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783225 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:31:44.787085 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783228 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:31:44.787085 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783231 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:31:44.787085 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.783236 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 14:31:44.787085 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783354 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:31:44.787085 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783359 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:31:44.787085 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783361 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783364 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783367 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783371 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783375 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783378 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783381 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783384 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783387 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783390 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783393 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783396 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783398 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783401 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783403 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783406 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783408 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783411 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:31:44.787459 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783413 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783416 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783418 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783421 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783423 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783426 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783429 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783432 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783435 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783437 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783440 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783442 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783445 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783448 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783450 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783453 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783455 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783458 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783460 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783463 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:31:44.787900 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783466 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783468 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783471 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783473 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783476 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783481 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783484 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783486 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783489 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783491 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783494 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783496 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783499 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783501 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783504 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783506 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783509 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783512 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783514 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783517 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:31:44.788371 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783520 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783522 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783524 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783540 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783543 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783546 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783549 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783551 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783555 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783558 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783561 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783564 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783567 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783570 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783572 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783575 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783579 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783582 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783586 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:31:44.788872 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783588 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783591 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783593 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783596 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783598 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783601 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783603 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783606 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783608 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783611 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783614 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783617 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783620 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783622 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783625 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783627 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783630 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783633 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783635 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:31:44.789318 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:44.783638 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:31:44.789853 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.783643 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 14:31:44.789853 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.783780 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 14:31:44.789853 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.786052 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 14:31:44.789853 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.787559 2581 server.go:1019] "Starting client certificate rotation" Jul 24 14:31:44.789853 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.787665 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 14:31:44.789853 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.787703 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 14:31:44.790455 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.790442 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 14:31:44.791689 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.791671 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 14:31:44.802369 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.802349 2581 log.go:25] "Validated CRI v1 runtime API" Jul 24 14:31:44.806036 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.806011 2581 log.go:25] "Validated CRI v1 image API" Jul 24 14:31:44.806933 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.806918 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 14:31:44.811209 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.811183 2581 fs.go:135] Filesystem UUIDs: map[4873d80c-f13e-4c11-9184-1ca9d6aeb76c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a2bc9fed-5a97-40a3-8fc4-4b9aacc4539f:/dev/nvme0n1p3] Jul 24 14:31:44.811275 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.811206 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 14:31:44.817969 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.817853 2581 manager.go:216] Machine: {Timestamp:2026-07-24 14:31:44.815979641 +0000 UTC m=+0.372895525 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099090 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec201cc8b9d921af6910fbb599555b4e SystemUUID:ec201cc8-b9d9-21af-6910-fbb599555b4e BootID:5758d39e-9a94-4067-9299-ec0d693dd5ac Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c8:9e:6a:eb:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c8:9e:6a:eb:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:4a:e0:e9:10:cd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 14:31:44.817969 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.817958 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 14:31:44.818107 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.818041 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 14:31:44.819427 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.819410 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 14:31:44.819954 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.819927 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 14:31:44.820120 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.819962 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-64.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 14:31:44.821512 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.821494 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 14:31:44.821596 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.821541 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 14:31:44.821596 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.821553 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 14:31:44.822314 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.822302 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 14:31:44.823401 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.823389 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 14:31:44.825408 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.825394 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 24 14:31:44.825563 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.825552 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 14:31:44.825632 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.825591 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 24 14:31:44.825632 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.825604 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 14:31:44.825632 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.825623 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 14:31:44.825748 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.825638 2581 kubelet.go:398] "Adding apiserver pod source" Jul 24 14:31:44.825748 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.825650 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 14:31:44.826032 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.826018 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 14:31:44.826105 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.826042 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 14:31:44.829542 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.829514 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 14:31:44.831943 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.831928 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 14:31:44.832012 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.831958 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 14:31:44.834139 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.834126 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 14:31:44.834197 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.834144 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 14:31:44.834197 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.834151 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 14:31:44.834197 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.834157 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 14:31:44.834197 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.834166 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 14:31:44.834197 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.834172 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 14:31:44.834197 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.834180 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 14:31:44.834197 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.834185 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 14:31:44.834197 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.834191 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 14:31:44.834197 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.834197 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 14:31:44.834457 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.834206 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 14:31:44.834457 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.834211 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 14:31:44.835097 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.835086 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 14:31:44.835097 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.835096 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 14:31:44.836794 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:44.836773 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 14:31:44.836860 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:44.836774 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 14:31:44.838452 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.838438 2581 server.go:1268] "Started kubelet" Jul 24 14:31:44.838554 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.838464 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 14:31:44.838606 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.838522 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 14:31:44.838659 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.838611 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 14:31:44.839271 ip-10-0-142-64 systemd[1]: Started Kubernetes Kubelet. Jul 24 14:31:44.840436 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.840424 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 24 14:31:44.841634 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.841615 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 14:31:44.846182 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:44.846165 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 14:31:44.849761 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.849732 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-64.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 14:31:44.850758 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:44.849745 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-64.ec2.internal.18c54047e43b441d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-64.ec2.internal,UID:ip-10-0-142-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-64.ec2.internal,},FirstTimestamp:2026-07-24 14:31:44.838214685 +0000 UTC m=+0.395130567,LastTimestamp:2026-07-24 14:31:44.838214685 +0000 UTC m=+0.395130567,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-64.ec2.internal,}" Jul 24 14:31:44.851015 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.851001 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 14:31:44.851015 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.851008 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 14:31:44.851119 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:44.851078 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-64.ec2.internal\" not found" Jul 24 14:31:44.851797 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.851778 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 14:31:44.851889 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.851808 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 14:31:44.851889 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.851783 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 14:31:44.851993 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.851893 2581 factory.go:55] Registering systemd factory Jul 24 14:31:44.851993 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.851907 2581 factory.go:223] Registration of the systemd container factory successfully Jul 24 14:31:44.851993 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.851967 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 24 14:31:44.851993 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.851976 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 24 14:31:44.852202 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.852187 2581 factory.go:153] Registering CRI-O factory Jul 24 14:31:44.852261 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.852205 2581 factory.go:223] Registration of the crio container factory successfully Jul 24 14:31:44.852312 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.852260 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 14:31:44.852312 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.852282 2581 factory.go:103] Registering Raw factory Jul 24 14:31:44.852312 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.852293 2581 manager.go:1196] Started watching for new ooms in manager Jul 24 14:31:44.852772 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.852745 2581 manager.go:349] Starting recovery of all containers Jul 24 14:31:44.862607 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.862571 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 14:31:44.864148 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:44.864120 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 14:31:44.864609 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:44.864563 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 14:31:44.867316 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.867298 2581 manager.go:354] Recovery completed Jul 24 14:31:44.868424 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.868402 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gxmp9" Jul 24 14:31:44.869197 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:44.869037 2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 24 14:31:44.872619 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.872598 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:31:44.874463 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.874446 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:31:44.874548 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.874478 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:31:44.874548 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.874493 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:31:44.874755 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.874734 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gxmp9" Jul 24 14:31:44.875062 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.875044 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 14:31:44.875062 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.875062 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 14:31:44.875156 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.875054 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:31:44.875156 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.875081 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 24 14:31:44.875809 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.875793 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:31:44.875896 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.875823 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:31:44.875896 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.875838 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:31:44.878452 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.878436 2581 policy_none.go:49] "None policy: Start" Jul 24 14:31:44.878515 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.878457 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 14:31:44.878515 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.878467 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 14:31:44.879733 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.879717 2581 policy_none.go:47] "Start" Jul 24 14:31:44.918170 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.918143 2581 manager.go:337] "Starting Device Plugin manager" Jul 24 14:31:44.929125 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:44.918190 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 14:31:44.929125 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.918203 2581 server.go:87] "Starting device plugin registration server" Jul 24 14:31:44.929125 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.918472 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 14:31:44.929125 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.918485 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 14:31:44.929125 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.918725 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 14:31:44.929125 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.918797 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 14:31:44.929125 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.918804 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 14:31:44.929125 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:44.919427 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 14:31:44.929125 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:44.919651 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-64.ec2.internal\" not found" Jul 24 14:31:44.965413 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.965385 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 14:31:44.965548 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.965437 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 14:31:44.965548 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.965465 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 14:31:44.965548 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:44.965513 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 14:31:44.967987 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:44.967968 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:31:45.019144 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.019047 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:31:45.019964 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.019945 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:31:45.020060 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.019976 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:31:45.020060 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.020002 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:31:45.020060 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.020033 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.035012 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.034991 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.035012 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.035014 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-64.ec2.internal\": node \"ip-10-0-142-64.ec2.internal\" not found" Jul 24 14:31:45.044372 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.044345 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-64.ec2.internal\" not found" Jul 24 14:31:45.065725 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.065694 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-64.ec2.internal"] Jul 24 14:31:45.065830 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.065763 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:31:45.067074 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.067055 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:31:45.067160 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.067086 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:31:45.067160 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.067104 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:31:45.068300 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.068285 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:31:45.068428 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.068411 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.068474 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.068444 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:31:45.068944 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.068922 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:31:45.068944 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.068935 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:31:45.069060 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.068950 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:31:45.069060 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.068960 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:31:45.069060 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.068959 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:31:45.069060 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.069036 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:31:45.070437 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.070424 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.070488 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.070447 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:31:45.071040 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.071024 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:31:45.071110 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.071051 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:31:45.071110 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.071061 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:31:45.092164 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.092143 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-64.ec2.internal\" not found" node="ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.096406 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.096389 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-64.ec2.internal\" not found" node="ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.144650 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.144629 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-64.ec2.internal\" not found" Jul 24 14:31:45.154491 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.154471 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1494d17fecc8d5a3360ffd411040120-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal\" (UID: \"a1494d17fecc8d5a3360ffd411040120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.154565 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.154498 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1494d17fecc8d5a3360ffd411040120-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal\" (UID: \"a1494d17fecc8d5a3360ffd411040120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.154565 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.154514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4771bee4c620d4964602556291e24ed3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-64.ec2.internal\" (UID: \"4771bee4c620d4964602556291e24ed3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.245631 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.245604 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-64.ec2.internal\" not found" Jul 24 14:31:45.255028 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.255003 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4771bee4c620d4964602556291e24ed3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-64.ec2.internal\" (UID: \"4771bee4c620d4964602556291e24ed3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.255077 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.255036 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1494d17fecc8d5a3360ffd411040120-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal\" (UID: \"a1494d17fecc8d5a3360ffd411040120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.255077 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.255053 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1494d17fecc8d5a3360ffd411040120-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal\" (UID: \"a1494d17fecc8d5a3360ffd411040120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.255139 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.255086 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1494d17fecc8d5a3360ffd411040120-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal\" (UID: \"a1494d17fecc8d5a3360ffd411040120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.255139 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.255092 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4771bee4c620d4964602556291e24ed3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-64.ec2.internal\" (UID: \"4771bee4c620d4964602556291e24ed3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.255139 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.255092 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1494d17fecc8d5a3360ffd411040120-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal\" (UID: \"a1494d17fecc8d5a3360ffd411040120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.346453 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.346426 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-64.ec2.internal\" not found" Jul 24 14:31:45.394974 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.394941 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.399907 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.399890 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.446866 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.446833 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-64.ec2.internal\" not found" Jul 24 14:31:45.548186 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.548158 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-64.ec2.internal\" not found" Jul 24 14:31:45.648301 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.648218 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-64.ec2.internal\" not found" Jul 24 14:31:45.653467 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.653446 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:31:45.749477 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.749426 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-64.ec2.internal\" not found" Jul 24 14:31:45.770429 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.770399 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:31:45.787023 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.787002 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 14:31:45.787156 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.787124 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 14:31:45.787218 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.787166 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 14:31:45.787218 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.787183 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 14:31:45.826512 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.826484 2581 apiserver.go:52] "Watching apiserver" Jul 24 14:31:45.841388 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.841362 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 14:31:45.842573 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.842528 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-56q9x","openshift-cluster-node-tuning-operator/tuned-w4274","openshift-multus/network-metrics-daemon-7s68w","openshift-ovn-kubernetes/ovnkube-node-5294p","kube-system/global-pull-secret-syncer-2p6b9","kube-system/konnectivity-agent-gbj8p","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz","openshift-image-registry/node-ca-wsdqx","openshift-multus/multus-additional-cni-plugins-gqx2c","openshift-multus/multus-vwgvc","openshift-network-diagnostics/network-check-target-k7w5x"] Jul 24 14:31:45.844282 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.844263 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-56q9x" Jul 24 14:31:45.845912 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.845888 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.847123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.847098 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:45.847238 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.847196 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:31:45.847238 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.847211 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 14:31:45.847353 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.847266 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 14:31:45.847353 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.847292 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wpl8t\"" Jul 24 14:31:45.847508 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.847494 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:31:45.848252 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.848229 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9gs42\"" Jul 24 14:31:45.848375 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.848253 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:31:45.848375 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.848256 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 14:31:45.848504 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.848426 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.849751 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.849729 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:45.849880 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.849805 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:31:45.850739 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.850719 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5jqhd\"" Jul 24 14:31:45.850860 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.850758 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 14:31:45.850972 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.850955 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 14:31:45.851020 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.850979 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 14:31:45.851020 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.851007 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 14:31:45.851149 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.851133 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 14:31:45.851210 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.851202 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.851256 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.851219 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 14:31:45.851365 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.851341 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 14:31:45.851472 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.851412 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gbj8p" Jul 24 14:31:45.852594 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.852576 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.853868 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.853837 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 14:31:45.853868 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.853858 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wsdqx" Jul 24 14:31:45.854027 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.853937 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cd6mt\"" Jul 24 14:31:45.854027 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.853963 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 14:31:45.854729 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.854708 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lmq8g\"" Jul 24 14:31:45.854844 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.854826 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 14:31:45.854911 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.854827 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 14:31:45.855141 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.855125 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 14:31:45.855483 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.855467 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:45.857838 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.856180 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 14:31:45.857838 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.857030 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 14:31:45.857838 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.857508 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4k888\"" Jul 24 14:31:45.857838 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.857767 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.858102 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.858449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-kubernetes\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.858514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-systemd\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.858537 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jv28m\"" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.858549 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.858565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfrl9\" (UniqueName: \"kubernetes.io/projected/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-kube-api-access-rfrl9\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.858623 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7wv2\" (UniqueName: \"kubernetes.io/projected/22897615-e1fd-4eb7-9694-81b23695e7a5-kube-api-access-s7wv2\") pod \"network-metrics-daemon-7s68w\" (UID: \"22897615-e1fd-4eb7-9694-81b23695e7a5\") " pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.858692 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-run-ovn-kubernetes\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.858730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-ovnkube-config\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.858763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-sysconfig\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.858795 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-sysctl-d\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.858855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-tmp\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.858933 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e46c7c4a-495c-4166-b129-ddb313b4731b-agent-certs\") pod \"konnectivity-agent-gbj8p\" (UID: \"e46c7c4a-495c-4166-b129-ddb313b4731b\") " pod="kube-system/konnectivity-agent-gbj8p" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.858988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-registration-dir\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859061 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-run-netns\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859095 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-sysctl-conf\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859127 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-sys\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.859435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-socket-dir\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859206 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-device-dir\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859347 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-etc-selinux\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859394 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-sys-fs\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859423 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fblwh\" (UniqueName: \"kubernetes.io/projected/d5866f23-6b47-4d0e-943e-017a1de7d581-kube-api-access-fblwh\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859457 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-systemd-units\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859493 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-run-systemd\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859525 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859530 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-var-lib-openvswitch\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859609 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-run-openvswitch\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859660 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret\") pod \"global-pull-secret-syncer-2p6b9\" (UID: \"7ca81320-80de-485a-8225-cc323e3cefc8\") " pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859698 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-tuned\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859718 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4d6c94a-3563-496b-b628-4f22549d7b44-host-slash\") pod \"iptables-alerter-56q9x\" (UID: \"b4d6c94a-3563-496b-b628-4f22549d7b44\") " pod="openshift-network-operator/iptables-alerter-56q9x" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859784 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssdxg\" (UniqueName: \"kubernetes.io/projected/b4d6c94a-3563-496b-b628-4f22549d7b44-kube-api-access-ssdxg\") pod \"iptables-alerter-56q9x\" (UID: \"b4d6c94a-3563-496b-b628-4f22549d7b44\") " pod="openshift-network-operator/iptables-alerter-56q9x" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-slash\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-log-socket\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859858 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 14:31:45.860283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-env-overrides\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859921 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-etc-openvswitch\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859952 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-ovn-node-metrics-cert\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.859983 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-modprobe-d\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860014 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4d6c94a-3563-496b-b628-4f22549d7b44-iptables-alerter-script\") pod \"iptables-alerter-56q9x\" (UID: \"b4d6c94a-3563-496b-b628-4f22549d7b44\") " pod="openshift-network-operator/iptables-alerter-56q9x" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-kubelet\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860078 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-cni-bin\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860125 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860163 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpxjw\" (UniqueName: \"kubernetes.io/projected/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-kube-api-access-kpxjw\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ca81320-80de-485a-8225-cc323e3cefc8-kubelet-config\") pod \"global-pull-secret-syncer-2p6b9\" (UID: \"7ca81320-80de-485a-8225-cc323e3cefc8\") " pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-host\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860310 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs\") pod \"network-metrics-daemon-7s68w\" (UID: \"22897615-e1fd-4eb7-9694-81b23695e7a5\") " pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860344 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860354 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-run-ovn\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860420 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-node-log\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.860421 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860476 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-ovnkube-script-lib\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.861123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860529 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-run\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.861900 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-lib-modules\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.861900 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-var-lib-kubelet\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.861900 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860652 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e46c7c4a-495c-4166-b129-ddb313b4731b-konnectivity-ca\") pod \"konnectivity-agent-gbj8p\" (UID: \"e46c7c4a-495c-4166-b129-ddb313b4731b\") " pod="kube-system/konnectivity-agent-gbj8p" Jul 24 14:31:45.861900 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860680 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.861900 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ca81320-80de-485a-8225-cc323e3cefc8-dbus\") pod \"global-pull-secret-syncer-2p6b9\" (UID: \"7ca81320-80de-485a-8225-cc323e3cefc8\") " pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:45.861900 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.860777 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-cni-netd\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.861900 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.861266 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 14:31:45.861900 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.861374 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 14:31:45.862364 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.862116 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hchwr\"" Jul 24 14:31:45.862905 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.862850 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 14:31:45.867733 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.867712 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 14:31:45.867848 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.867800 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-64.ec2.internal" Jul 24 14:31:45.867989 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.867972 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal"] Jul 24 14:31:45.876649 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.876632 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 14:31:45.876770 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.876755 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-64.ec2.internal"] Jul 24 14:31:45.880818 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.880769 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 14:26:44 +0000 UTC" deadline="2028-03-19 16:58:22.49789932 +0000 UTC" Jul 24 14:31:45.880818 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.880811 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14498h26m36.617090875s" Jul 24 14:31:45.889440 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.889421 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vqd5d" Jul 24 14:31:45.898773 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.898709 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vqd5d" Jul 24 14:31:45.943342 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:45.943308 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4771bee4c620d4964602556291e24ed3.slice/crio-bb77e06e03843ea6428b4cb6b9b155d37d37d5567ae1687067469d99aa4c601f WatchSource:0}: Error finding container bb77e06e03843ea6428b4cb6b9b155d37d37d5567ae1687067469d99aa4c601f: Status 404 returned error can't find the container with id bb77e06e03843ea6428b4cb6b9b155d37d37d5567ae1687067469d99aa4c601f Jul 24 14:31:45.944493 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:45.944465 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1494d17fecc8d5a3360ffd411040120.slice/crio-3211c7422344d80177a4e181ec7224a08478b8d131a5551dddcda4206c441fa6 WatchSource:0}: Error finding container 3211c7422344d80177a4e181ec7224a08478b8d131a5551dddcda4206c441fa6: Status 404 returned error can't find the container with id 3211c7422344d80177a4e181ec7224a08478b8d131a5551dddcda4206c441fa6 Jul 24 14:31:45.950370 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.950344 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 14:31:45.952918 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.952899 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 14:31:45.961198 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961175 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-sysctl-conf\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.961283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961213 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-sys\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.961283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961240 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-sys-fs\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.961395 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961270 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f801522b-b504-4771-bfd2-0f4f0d52affd-cni-binary-copy\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:45.961395 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-var-lib-cni-bin\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.961395 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961315 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-sys\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.961395 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961342 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-systemd-units\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.961395 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961353 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-sysctl-conf\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.961395 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-run-systemd\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.961395 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961395 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-run-openvswitch\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.961788 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961400 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-systemd-units\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.961788 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961414 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-sys-fs\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.961788 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret\") pod \"global-pull-secret-syncer-2p6b9\" (UID: \"7ca81320-80de-485a-8225-cc323e3cefc8\") " pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:45.961788 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961456 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-run-openvswitch\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.961788 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-system-cni-dir\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.961788 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961486 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-run-k8s-cni-cncf-io\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.961788 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961416 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-run-systemd\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.961788 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4d6c94a-3563-496b-b628-4f22549d7b44-host-slash\") pod \"iptables-alerter-56q9x\" (UID: \"b4d6c94a-3563-496b-b628-4f22549d7b44\") " pod="openshift-network-operator/iptables-alerter-56q9x" Jul 24 14:31:45.961788 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.961622 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:31:45.961788 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f801522b-b504-4771-bfd2-0f4f0d52affd-cnibin\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:45.961788 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961623 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4d6c94a-3563-496b-b628-4f22549d7b44-host-slash\") pod \"iptables-alerter-56q9x\" (UID: \"b4d6c94a-3563-496b-b628-4f22549d7b44\") " pod="openshift-network-operator/iptables-alerter-56q9x" Jul 24 14:31:45.961788 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.961677 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret podName:7ca81320-80de-485a-8225-cc323e3cefc8 nodeName:}" failed. No retries permitted until 2026-07-24 14:31:46.461659588 +0000 UTC m=+2.018575460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret") pod "global-pull-secret-syncer-2p6b9" (UID: "7ca81320-80de-485a-8225-cc323e3cefc8") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:31:45.961788 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961693 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-cnibin\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.961788 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961718 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-modprobe-d\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.961788 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961738 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-multus-socket-dir-parent\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-run-multus-certs\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961856 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2m7c\" (UniqueName: \"kubernetes.io/projected/38648634-ad37-495e-993d-e18db1878323-kube-api-access-g2m7c\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961904 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-modprobe-d\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961901 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-kubelet\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961934 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-kubelet\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpxjw\" (UniqueName: \"kubernetes.io/projected/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-kube-api-access-kpxjw\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ca81320-80de-485a-8225-cc323e3cefc8-kubelet-config\") pod \"global-pull-secret-syncer-2p6b9\" (UID: \"7ca81320-80de-485a-8225-cc323e3cefc8\") " pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.961994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-host\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962039 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-run-netns\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-socket-dir\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962067 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ca81320-80de-485a-8225-cc323e3cefc8-kubelet-config\") pod \"global-pull-secret-syncer-2p6b9\" (UID: \"7ca81320-80de-485a-8225-cc323e3cefc8\") " pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-node-log\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962063 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-host\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962107 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-ovnkube-script-lib\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962158 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-node-log\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962195 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e46c7c4a-495c-4166-b129-ddb313b4731b-konnectivity-ca\") pod \"konnectivity-agent-gbj8p\" (UID: \"e46c7c4a-495c-4166-b129-ddb313b4731b\") " pod="kube-system/konnectivity-agent-gbj8p" Jul 24 14:31:45.962620 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962196 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-socket-dir\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962294 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f801522b-b504-4771-bfd2-0f4f0d52affd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962319 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-var-lib-cni-multus\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7703c0af-9df4-4f61-980a-558ccfe28fee-serviceca\") pod \"node-ca-wsdqx\" (UID: \"7703c0af-9df4-4f61-980a-558ccfe28fee\") " pod="openshift-image-registry/node-ca-wsdqx" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962375 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962394 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-registration-dir\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ca81320-80de-485a-8225-cc323e3cefc8-dbus\") pod \"global-pull-secret-syncer-2p6b9\" (UID: \"7ca81320-80de-485a-8225-cc323e3cefc8\") " pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962435 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-registration-dir\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-kubernetes\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-systemd\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7wv2\" (UniqueName: \"kubernetes.io/projected/22897615-e1fd-4eb7-9694-81b23695e7a5-kube-api-access-s7wv2\") pod \"network-metrics-daemon-7s68w\" (UID: \"22897615-e1fd-4eb7-9694-81b23695e7a5\") " pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962528 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f801522b-b504-4771-bfd2-0f4f0d52affd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962556 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-etc-kubernetes\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962582 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-systemd\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962557 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-kubernetes\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwjqh\" (UniqueName: \"kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh\") pod \"network-check-target-k7w5x\" (UID: \"33267e5b-9b26-472f-8b36-6fc795d5131d\") " pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:31:45.963507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-run-ovn-kubernetes\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962640 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ca81320-80de-485a-8225-cc323e3cefc8-dbus\") pod \"global-pull-secret-syncer-2p6b9\" (UID: \"7ca81320-80de-485a-8225-cc323e3cefc8\") " pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-sysctl-d\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962749 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-tmp\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e46c7c4a-495c-4166-b129-ddb313b4731b-agent-certs\") pod \"konnectivity-agent-gbj8p\" (UID: \"e46c7c4a-495c-4166-b129-ddb313b4731b\") " pod="kube-system/konnectivity-agent-gbj8p" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fblwh\" (UniqueName: \"kubernetes.io/projected/d5866f23-6b47-4d0e-943e-017a1de7d581-kube-api-access-fblwh\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962851 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-run-ovn-kubernetes\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f801522b-b504-4771-bfd2-0f4f0d52affd-os-release\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962896 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-var-lib-kubelet\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-run-netns\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962961 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-var-lib-openvswitch\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962965 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-ovnkube-script-lib\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.962988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-tuned\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963024 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwgt7\" (UniqueName: \"kubernetes.io/projected/f801522b-b504-4771-bfd2-0f4f0d52affd-kube-api-access-fwgt7\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963031 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e46c7c4a-495c-4166-b129-ddb313b4731b-konnectivity-ca\") pod \"konnectivity-agent-gbj8p\" (UID: \"e46c7c4a-495c-4166-b129-ddb313b4731b\") " pod="kube-system/konnectivity-agent-gbj8p" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38648634-ad37-495e-993d-e18db1878323-multus-daemon-config\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963069 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-run-netns\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.964446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963083 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7703c0af-9df4-4f61-980a-558ccfe28fee-host\") pod \"node-ca-wsdqx\" (UID: \"7703c0af-9df4-4f61-980a-558ccfe28fee\") " pod="openshift-image-registry/node-ca-wsdqx" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963119 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssdxg\" (UniqueName: \"kubernetes.io/projected/b4d6c94a-3563-496b-b628-4f22549d7b44-kube-api-access-ssdxg\") pod \"iptables-alerter-56q9x\" (UID: \"b4d6c94a-3563-496b-b628-4f22549d7b44\") " pod="openshift-network-operator/iptables-alerter-56q9x" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963157 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-var-lib-openvswitch\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-slash\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963214 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-slash\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963250 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-sysctl-d\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963289 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963309 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-log-socket\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-env-overrides\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963433 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-log-socket\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f801522b-b504-4771-bfd2-0f4f0d52affd-system-cni-dir\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963481 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-multus-cni-dir\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963506 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-hostroot\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963527 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-multus-conf-dir\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963572 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-etc-openvswitch\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-ovn-node-metrics-cert\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m5ms\" (UniqueName: \"kubernetes.io/projected/7703c0af-9df4-4f61-980a-558ccfe28fee-kube-api-access-7m5ms\") pod \"node-ca-wsdqx\" (UID: \"7703c0af-9df4-4f61-980a-558ccfe28fee\") " pod="openshift-image-registry/node-ca-wsdqx" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963701 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-etc-openvswitch\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.965345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4d6c94a-3563-496b-b628-4f22549d7b44-iptables-alerter-script\") pod \"iptables-alerter-56q9x\" (UID: \"b4d6c94a-3563-496b-b628-4f22549d7b44\") " pod="openshift-network-operator/iptables-alerter-56q9x" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963748 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-cni-bin\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963776 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs\") pod \"network-metrics-daemon-7s68w\" (UID: \"22897615-e1fd-4eb7-9694-81b23695e7a5\") " pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963878 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-os-release\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38648634-ad37-495e-993d-e18db1878323-cni-binary-copy\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963922 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-env-overrides\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963945 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-device-dir\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.963994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-etc-selinux\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-run-ovn\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-run\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964113 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-lib-modules\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964136 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-var-lib-kubelet\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964168 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-cni-netd\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964208 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfrl9\" (UniqueName: \"kubernetes.io/projected/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-kube-api-access-rfrl9\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f801522b-b504-4771-bfd2-0f4f0d52affd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-ovnkube-config\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.966130 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-sysconfig\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.967115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964379 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4d6c94a-3563-496b-b628-4f22549d7b44-iptables-alerter-script\") pod \"iptables-alerter-56q9x\" (UID: \"b4d6c94a-3563-496b-b628-4f22549d7b44\") " pod="openshift-network-operator/iptables-alerter-56q9x" Jul 24 14:31:45.967115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964407 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-sysconfig\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.967115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964467 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.967115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964538 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-cni-bin\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.967115 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.964669 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:31:45.967115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964711 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-lib-modules\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.967115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964787 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-var-lib-kubelet\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.967115 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:45.964842 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs podName:22897615-e1fd-4eb7-9694-81b23695e7a5 nodeName:}" failed. No retries permitted until 2026-07-24 14:31:46.464818559 +0000 UTC m=+2.021734437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs") pod "network-metrics-daemon-7s68w" (UID: "22897615-e1fd-4eb7-9694-81b23695e7a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:31:45.967115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964835 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-host-cni-netd\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.967115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964905 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-run-ovn\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.967115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.964911 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-run\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.967115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.965065 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-device-dir\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.967115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.965164 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5866f23-6b47-4d0e-943e-017a1de7d581-etc-selinux\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:45.967741 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.967493 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-tmp\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.967741 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.965666 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-ovnkube-config\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.967741 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.967470 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-etc-tuned\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.971563 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.968036 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e46c7c4a-495c-4166-b129-ddb313b4731b-agent-certs\") pod \"konnectivity-agent-gbj8p\" (UID: \"e46c7c4a-495c-4166-b129-ddb313b4731b\") " pod="kube-system/konnectivity-agent-gbj8p" Jul 24 14:31:45.971563 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.970377 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-64.ec2.internal" event={"ID":"4771bee4c620d4964602556291e24ed3","Type":"ContainerStarted","Data":"bb77e06e03843ea6428b4cb6b9b155d37d37d5567ae1687067469d99aa4c601f"} Jul 24 14:31:45.972761 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.971991 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal" event={"ID":"a1494d17fecc8d5a3360ffd411040120","Type":"ContainerStarted","Data":"3211c7422344d80177a4e181ec7224a08478b8d131a5551dddcda4206c441fa6"} Jul 24 14:31:45.972761 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.972605 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-ovn-node-metrics-cert\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.974526 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.974498 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpxjw\" (UniqueName: \"kubernetes.io/projected/28c3edc3-9454-48a6-b3fa-bcde5f0666f5-kube-api-access-kpxjw\") pod \"ovnkube-node-5294p\" (UID: \"28c3edc3-9454-48a6-b3fa-bcde5f0666f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:45.974780 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.974762 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfrl9\" (UniqueName: \"kubernetes.io/projected/6813ce9b-a924-40a0-8ee8-41e50e4a9e7c-kube-api-access-rfrl9\") pod \"tuned-w4274\" (UID: \"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c\") " pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:45.975746 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.975728 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7wv2\" (UniqueName: \"kubernetes.io/projected/22897615-e1fd-4eb7-9694-81b23695e7a5-kube-api-access-s7wv2\") pod \"network-metrics-daemon-7s68w\" (UID: \"22897615-e1fd-4eb7-9694-81b23695e7a5\") " pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:45.976134 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.976113 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssdxg\" (UniqueName: \"kubernetes.io/projected/b4d6c94a-3563-496b-b628-4f22549d7b44-kube-api-access-ssdxg\") pod \"iptables-alerter-56q9x\" (UID: \"b4d6c94a-3563-496b-b628-4f22549d7b44\") " pod="openshift-network-operator/iptables-alerter-56q9x" Jul 24 14:31:45.976413 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:45.976397 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fblwh\" (UniqueName: \"kubernetes.io/projected/d5866f23-6b47-4d0e-943e-017a1de7d581-kube-api-access-fblwh\") pod \"aws-ebs-csi-driver-node-z5wrz\" (UID: \"d5866f23-6b47-4d0e-943e-017a1de7d581\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:46.003994 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.003973 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:31:46.065698 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.065667 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-run-netns\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.065698 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.065701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f801522b-b504-4771-bfd2-0f4f0d52affd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.065936 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.065720 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-var-lib-cni-multus\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.065936 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.065738 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7703c0af-9df4-4f61-980a-558ccfe28fee-serviceca\") pod \"node-ca-wsdqx\" (UID: \"7703c0af-9df4-4f61-980a-558ccfe28fee\") " pod="openshift-image-registry/node-ca-wsdqx" Jul 24 14:31:46.065936 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.065762 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f801522b-b504-4771-bfd2-0f4f0d52affd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.065936 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.065780 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-etc-kubernetes\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.065936 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.065779 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-run-netns\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.065936 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.065798 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjqh\" (UniqueName: \"kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh\") pod \"network-check-target-k7w5x\" (UID: \"33267e5b-9b26-472f-8b36-6fc795d5131d\") " pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:31:46.065936 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.065809 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-var-lib-cni-multus\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.065936 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.065850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f801522b-b504-4771-bfd2-0f4f0d52affd-os-release\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.065936 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.065877 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-etc-kubernetes\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.065936 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.065921 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f801522b-b504-4771-bfd2-0f4f0d52affd-os-release\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.065936 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.065927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-var-lib-kubelet\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.065954 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-var-lib-kubelet\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.065928 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f801522b-b504-4771-bfd2-0f4f0d52affd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.065960 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwgt7\" (UniqueName: \"kubernetes.io/projected/f801522b-b504-4771-bfd2-0f4f0d52affd-kube-api-access-fwgt7\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38648634-ad37-495e-993d-e18db1878323-multus-daemon-config\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066032 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7703c0af-9df4-4f61-980a-558ccfe28fee-host\") pod \"node-ca-wsdqx\" (UID: \"7703c0af-9df4-4f61-980a-558ccfe28fee\") " pod="openshift-image-registry/node-ca-wsdqx" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066058 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f801522b-b504-4771-bfd2-0f4f0d52affd-system-cni-dir\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-multus-cni-dir\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066106 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-hostroot\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066111 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7703c0af-9df4-4f61-980a-558ccfe28fee-host\") pod \"node-ca-wsdqx\" (UID: \"7703c0af-9df4-4f61-980a-558ccfe28fee\") " pod="openshift-image-registry/node-ca-wsdqx" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066131 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-multus-conf-dir\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066160 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m5ms\" (UniqueName: \"kubernetes.io/projected/7703c0af-9df4-4f61-980a-558ccfe28fee-kube-api-access-7m5ms\") pod \"node-ca-wsdqx\" (UID: \"7703c0af-9df4-4f61-980a-558ccfe28fee\") " pod="openshift-image-registry/node-ca-wsdqx" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066165 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-multus-cni-dir\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066171 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-hostroot\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066194 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f801522b-b504-4771-bfd2-0f4f0d52affd-system-cni-dir\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066216 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-multus-conf-dir\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066246 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-os-release\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38648634-ad37-495e-993d-e18db1878323-cni-binary-copy\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.066528 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066306 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-os-release\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066306 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f801522b-b504-4771-bfd2-0f4f0d52affd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066337 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f801522b-b504-4771-bfd2-0f4f0d52affd-cni-binary-copy\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-var-lib-cni-bin\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066371 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7703c0af-9df4-4f61-980a-558ccfe28fee-serviceca\") pod \"node-ca-wsdqx\" (UID: \"7703c0af-9df4-4f61-980a-558ccfe28fee\") " pod="openshift-image-registry/node-ca-wsdqx" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066424 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-system-cni-dir\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066450 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f801522b-b504-4771-bfd2-0f4f0d52affd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066457 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-run-k8s-cni-cncf-io\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f801522b-b504-4771-bfd2-0f4f0d52affd-cnibin\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066514 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-cnibin\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066516 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38648634-ad37-495e-993d-e18db1878323-multus-daemon-config\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066526 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-system-cni-dir\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066538 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-multus-socket-dir-parent\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066563 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-run-multus-certs\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066571 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-run-k8s-cni-cncf-io\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066592 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f801522b-b504-4771-bfd2-0f4f0d52affd-cnibin\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2m7c\" (UniqueName: \"kubernetes.io/projected/38648634-ad37-495e-993d-e18db1878323-kube-api-access-g2m7c\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066640 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-run-multus-certs\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.067220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066652 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-cnibin\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.067783 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066687 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-multus-socket-dir-parent\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.067783 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066723 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38648634-ad37-495e-993d-e18db1878323-cni-binary-copy\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.067783 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066755 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38648634-ad37-495e-993d-e18db1878323-host-var-lib-cni-bin\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.067783 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066878 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f801522b-b504-4771-bfd2-0f4f0d52affd-cni-binary-copy\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.067783 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.066907 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f801522b-b504-4771-bfd2-0f4f0d52affd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.073399 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:46.073374 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:31:46.073512 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:46.073402 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:31:46.073512 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:46.073418 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xwjqh for pod openshift-network-diagnostics/network-check-target-k7w5x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:31:46.073512 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:46.073504 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh podName:33267e5b-9b26-472f-8b36-6fc795d5131d nodeName:}" failed. No retries permitted until 2026-07-24 14:31:46.573484719 +0000 UTC m=+2.130400608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xwjqh" (UniqueName: "kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh") pod "network-check-target-k7w5x" (UID: "33267e5b-9b26-472f-8b36-6fc795d5131d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:31:46.075311 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.075279 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m5ms\" (UniqueName: \"kubernetes.io/projected/7703c0af-9df4-4f61-980a-558ccfe28fee-kube-api-access-7m5ms\") pod \"node-ca-wsdqx\" (UID: \"7703c0af-9df4-4f61-980a-558ccfe28fee\") " pod="openshift-image-registry/node-ca-wsdqx" Jul 24 14:31:46.075645 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.075626 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwgt7\" (UniqueName: \"kubernetes.io/projected/f801522b-b504-4771-bfd2-0f4f0d52affd-kube-api-access-fwgt7\") pod \"multus-additional-cni-plugins-gqx2c\" (UID: \"f801522b-b504-4771-bfd2-0f4f0d52affd\") " pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.075906 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.075885 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2m7c\" (UniqueName: \"kubernetes.io/projected/38648634-ad37-495e-993d-e18db1878323-kube-api-access-g2m7c\") pod \"multus-vwgvc\" (UID: \"38648634-ad37-495e-993d-e18db1878323\") " pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.167064 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.166982 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-56q9x" Jul 24 14:31:46.175290 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.175269 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w4274" Jul 24 14:31:46.176288 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:46.176265 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d6c94a_3563_496b_b628_4f22549d7b44.slice/crio-48342a232dcf70d17e8fca9a2b2d85cf9b65fc3b527d27a7b56233ea2e88ada5 WatchSource:0}: Error finding container 48342a232dcf70d17e8fca9a2b2d85cf9b65fc3b527d27a7b56233ea2e88ada5: Status 404 returned error can't find the container with id 48342a232dcf70d17e8fca9a2b2d85cf9b65fc3b527d27a7b56233ea2e88ada5 Jul 24 14:31:46.183223 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:46.183197 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6813ce9b_a924_40a0_8ee8_41e50e4a9e7c.slice/crio-e929af12128465b3a8a5bf7968b185e17bbf5f4b8c5c8c0c5249f014254fc6aa WatchSource:0}: Error finding container e929af12128465b3a8a5bf7968b185e17bbf5f4b8c5c8c0c5249f014254fc6aa: Status 404 returned error can't find the container with id e929af12128465b3a8a5bf7968b185e17bbf5f4b8c5c8c0c5249f014254fc6aa Jul 24 14:31:46.206790 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.206765 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:31:46.214064 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:46.214042 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28c3edc3_9454_48a6_b3fa_bcde5f0666f5.slice/crio-5af09b9b9483cb0dfe3902afd47236e03b33df890998fed86b3c1de123a7dff5 WatchSource:0}: Error finding container 5af09b9b9483cb0dfe3902afd47236e03b33df890998fed86b3c1de123a7dff5: Status 404 returned error can't find the container with id 5af09b9b9483cb0dfe3902afd47236e03b33df890998fed86b3c1de123a7dff5 Jul 24 14:31:46.222317 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.222298 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gbj8p" Jul 24 14:31:46.230319 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:46.230299 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46c7c4a_495c_4166_b129_ddb313b4731b.slice/crio-46c8cdac191e066a11edb802902d1579fa4e18064aa33daf5775cd8acaabc797 WatchSource:0}: Error finding container 46c8cdac191e066a11edb802902d1579fa4e18064aa33daf5775cd8acaabc797: Status 404 returned error can't find the container with id 46c8cdac191e066a11edb802902d1579fa4e18064aa33daf5775cd8acaabc797 Jul 24 14:31:46.239338 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.239320 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" Jul 24 14:31:46.247193 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:46.247173 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5866f23_6b47_4d0e_943e_017a1de7d581.slice/crio-8b179056913783a842b7ef60e72a962dfe5cc0e900febd5058b333437e672274 WatchSource:0}: Error finding container 8b179056913783a842b7ef60e72a962dfe5cc0e900febd5058b333437e672274: Status 404 returned error can't find the container with id 8b179056913783a842b7ef60e72a962dfe5cc0e900febd5058b333437e672274 Jul 24 14:31:46.255401 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.255381 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wsdqx" Jul 24 14:31:46.261602 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.261576 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gqx2c" Jul 24 14:31:46.262366 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:46.262342 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7703c0af_9df4_4f61_980a_558ccfe28fee.slice/crio-d61b342f34a01d4fe974e6d57c4cdc85178f2d7ed841ec6b88465bdf9b741675 WatchSource:0}: Error finding container d61b342f34a01d4fe974e6d57c4cdc85178f2d7ed841ec6b88465bdf9b741675: Status 404 returned error can't find the container with id d61b342f34a01d4fe974e6d57c4cdc85178f2d7ed841ec6b88465bdf9b741675 Jul 24 14:31:46.269579 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:46.269556 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf801522b_b504_4771_bfd2_0f4f0d52affd.slice/crio-7dc9cc56e9d908cb940bd43dab0531d2730fc8ce3c1723349f68c41eb5b9c6b3 WatchSource:0}: Error finding container 7dc9cc56e9d908cb940bd43dab0531d2730fc8ce3c1723349f68c41eb5b9c6b3: Status 404 returned error can't find the container with id 7dc9cc56e9d908cb940bd43dab0531d2730fc8ce3c1723349f68c41eb5b9c6b3 Jul 24 14:31:46.275795 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.275775 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vwgvc" Jul 24 14:31:46.283211 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:31:46.283190 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38648634_ad37_495e_993d_e18db1878323.slice/crio-2a65b814e52cf737c2f78b19751131d057d905e8e4ca0d81c63a119a9c8a649c WatchSource:0}: Error finding container 2a65b814e52cf737c2f78b19751131d057d905e8e4ca0d81c63a119a9c8a649c: Status 404 returned error can't find the container with id 2a65b814e52cf737c2f78b19751131d057d905e8e4ca0d81c63a119a9c8a649c Jul 24 14:31:46.468987 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.468899 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs\") pod \"network-metrics-daemon-7s68w\" (UID: \"22897615-e1fd-4eb7-9694-81b23695e7a5\") " pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:46.468987 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.468959 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret\") pod \"global-pull-secret-syncer-2p6b9\" (UID: \"7ca81320-80de-485a-8225-cc323e3cefc8\") " pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:46.469200 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:46.469082 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:31:46.469200 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:46.469149 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret podName:7ca81320-80de-485a-8225-cc323e3cefc8 nodeName:}" failed. No retries permitted until 2026-07-24 14:31:47.46912988 +0000 UTC m=+3.026045767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret") pod "global-pull-secret-syncer-2p6b9" (UID: "7ca81320-80de-485a-8225-cc323e3cefc8") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:31:46.469200 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:46.469082 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:31:46.469357 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:46.469237 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs podName:22897615-e1fd-4eb7-9694-81b23695e7a5 nodeName:}" failed. No retries permitted until 2026-07-24 14:31:47.469219105 +0000 UTC m=+3.026134978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs") pod "network-metrics-daemon-7s68w" (UID: "22897615-e1fd-4eb7-9694-81b23695e7a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:31:46.671172 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.671136 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjqh\" (UniqueName: \"kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh\") pod \"network-check-target-k7w5x\" (UID: \"33267e5b-9b26-472f-8b36-6fc795d5131d\") " pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:31:46.671364 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:46.671330 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:31:46.671364 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:46.671358 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:31:46.671470 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:46.671374 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xwjqh for pod openshift-network-diagnostics/network-check-target-k7w5x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:31:46.671470 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:46.671445 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh podName:33267e5b-9b26-472f-8b36-6fc795d5131d nodeName:}" failed. No retries permitted until 2026-07-24 14:31:47.671424343 +0000 UTC m=+3.228340218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwjqh" (UniqueName: "kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh") pod "network-check-target-k7w5x" (UID: "33267e5b-9b26-472f-8b36-6fc795d5131d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:31:46.901675 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.901617 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 14:26:45 +0000 UTC" deadline="2028-01-21 08:12:40.818032688 +0000 UTC" Jul 24 14:31:46.901675 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.901673 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13097h40m53.916364989s" Jul 24 14:31:46.966983 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.966951 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:46.967161 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:46.967108 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:31:46.992065 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:46.991975 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vwgvc" event={"ID":"38648634-ad37-495e-993d-e18db1878323","Type":"ContainerStarted","Data":"2a65b814e52cf737c2f78b19751131d057d905e8e4ca0d81c63a119a9c8a649c"} Jul 24 14:31:47.000648 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:47.000546 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx2c" event={"ID":"f801522b-b504-4771-bfd2-0f4f0d52affd","Type":"ContainerStarted","Data":"7dc9cc56e9d908cb940bd43dab0531d2730fc8ce3c1723349f68c41eb5b9c6b3"} Jul 24 14:31:47.005157 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:47.005013 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wsdqx" event={"ID":"7703c0af-9df4-4f61-980a-558ccfe28fee","Type":"ContainerStarted","Data":"d61b342f34a01d4fe974e6d57c4cdc85178f2d7ed841ec6b88465bdf9b741675"} Jul 24 14:31:47.025723 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:47.025685 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" event={"ID":"d5866f23-6b47-4d0e-943e-017a1de7d581","Type":"ContainerStarted","Data":"8b179056913783a842b7ef60e72a962dfe5cc0e900febd5058b333437e672274"} Jul 24 14:31:47.048138 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:47.048101 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-56q9x" event={"ID":"b4d6c94a-3563-496b-b628-4f22549d7b44","Type":"ContainerStarted","Data":"48342a232dcf70d17e8fca9a2b2d85cf9b65fc3b527d27a7b56233ea2e88ada5"} Jul 24 14:31:47.056903 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:47.056826 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gbj8p" event={"ID":"e46c7c4a-495c-4166-b129-ddb313b4731b","Type":"ContainerStarted","Data":"46c8cdac191e066a11edb802902d1579fa4e18064aa33daf5775cd8acaabc797"} Jul 24 14:31:47.061064 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:47.060977 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" event={"ID":"28c3edc3-9454-48a6-b3fa-bcde5f0666f5","Type":"ContainerStarted","Data":"5af09b9b9483cb0dfe3902afd47236e03b33df890998fed86b3c1de123a7dff5"} Jul 24 14:31:47.062843 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:47.062652 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:31:47.068038 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:47.068015 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w4274" event={"ID":"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c","Type":"ContainerStarted","Data":"e929af12128465b3a8a5bf7968b185e17bbf5f4b8c5c8c0c5249f014254fc6aa"} Jul 24 14:31:47.477516 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:47.477473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs\") pod \"network-metrics-daemon-7s68w\" (UID: \"22897615-e1fd-4eb7-9694-81b23695e7a5\") " pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:47.477709 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:47.477557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret\") pod \"global-pull-secret-syncer-2p6b9\" (UID: \"7ca81320-80de-485a-8225-cc323e3cefc8\") " pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:47.477709 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:47.477655 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:31:47.477834 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:47.477669 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:31:47.477834 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:47.477737 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs podName:22897615-e1fd-4eb7-9694-81b23695e7a5 nodeName:}" failed. No retries permitted until 2026-07-24 14:31:49.477714847 +0000 UTC m=+5.034630729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs") pod "network-metrics-daemon-7s68w" (UID: "22897615-e1fd-4eb7-9694-81b23695e7a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:31:47.477834 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:47.477764 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret podName:7ca81320-80de-485a-8225-cc323e3cefc8 nodeName:}" failed. No retries permitted until 2026-07-24 14:31:49.477748754 +0000 UTC m=+5.034664628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret") pod "global-pull-secret-syncer-2p6b9" (UID: "7ca81320-80de-485a-8225-cc323e3cefc8") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:31:47.679047 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:47.679010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjqh\" (UniqueName: \"kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh\") pod \"network-check-target-k7w5x\" (UID: \"33267e5b-9b26-472f-8b36-6fc795d5131d\") " pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:31:47.679251 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:47.679193 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:31:47.679251 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:47.679212 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:31:47.679251 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:47.679225 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xwjqh for pod openshift-network-diagnostics/network-check-target-k7w5x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:31:47.679379 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:47.679291 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh podName:33267e5b-9b26-472f-8b36-6fc795d5131d nodeName:}" failed. No retries permitted until 2026-07-24 14:31:49.67926487 +0000 UTC m=+5.236180775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwjqh" (UniqueName: "kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh") pod "network-check-target-k7w5x" (UID: "33267e5b-9b26-472f-8b36-6fc795d5131d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:31:47.902203 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:47.901837 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 14:26:45 +0000 UTC" deadline="2028-04-21 11:48:21.370536042 +0000 UTC" Jul 24 14:31:47.902203 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:47.901901 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15285h16m33.468639641s" Jul 24 14:31:47.966938 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:47.966255 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:31:47.966938 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:47.966381 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:31:47.966938 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:47.966781 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:47.966938 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:47.966884 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:31:48.145308 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:48.145272 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:31:48.377757 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:48.377727 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:31:48.970287 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:48.970261 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:48.970730 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:48.970394 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:31:49.494296 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:49.493417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs\") pod \"network-metrics-daemon-7s68w\" (UID: \"22897615-e1fd-4eb7-9694-81b23695e7a5\") " pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:49.494296 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:49.493483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret\") pod \"global-pull-secret-syncer-2p6b9\" (UID: \"7ca81320-80de-485a-8225-cc323e3cefc8\") " pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:49.494296 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:49.493672 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:31:49.494296 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:49.493737 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret podName:7ca81320-80de-485a-8225-cc323e3cefc8 nodeName:}" failed. No retries permitted until 2026-07-24 14:31:53.493718826 +0000 UTC m=+9.050634713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret") pod "global-pull-secret-syncer-2p6b9" (UID: "7ca81320-80de-485a-8225-cc323e3cefc8") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:31:49.494296 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:49.494142 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:31:49.494296 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:49.494194 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs podName:22897615-e1fd-4eb7-9694-81b23695e7a5 nodeName:}" failed. No retries permitted until 2026-07-24 14:31:53.494177887 +0000 UTC m=+9.051093759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs") pod "network-metrics-daemon-7s68w" (UID: "22897615-e1fd-4eb7-9694-81b23695e7a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:31:49.696311 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:49.695678 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjqh\" (UniqueName: \"kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh\") pod \"network-check-target-k7w5x\" (UID: \"33267e5b-9b26-472f-8b36-6fc795d5131d\") " pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:31:49.696311 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:49.695870 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:31:49.696311 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:49.695890 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:31:49.696311 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:49.695904 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xwjqh for pod openshift-network-diagnostics/network-check-target-k7w5x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:31:49.696311 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:49.695969 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh podName:33267e5b-9b26-472f-8b36-6fc795d5131d nodeName:}" failed. No retries permitted until 2026-07-24 14:31:53.69594445 +0000 UTC m=+9.252860341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwjqh" (UniqueName: "kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh") pod "network-check-target-k7w5x" (UID: "33267e5b-9b26-472f-8b36-6fc795d5131d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:31:49.966959 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:49.966474 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:49.966959 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:49.966630 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:31:49.966959 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:49.966660 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:31:49.966959 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:49.966767 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:31:50.967200 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:50.966635 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:50.967200 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:50.966770 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:31:51.966322 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:51.966284 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:51.966495 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:51.966431 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:31:51.967083 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:51.966837 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:31:51.967083 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:51.966931 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:31:52.966228 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:52.966191 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:52.966682 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:52.966320 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:31:53.526718 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:53.526659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret\") pod \"global-pull-secret-syncer-2p6b9\" (UID: \"7ca81320-80de-485a-8225-cc323e3cefc8\") " pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:53.526893 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:53.526767 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs\") pod \"network-metrics-daemon-7s68w\" (UID: \"22897615-e1fd-4eb7-9694-81b23695e7a5\") " pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:53.526957 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:53.526908 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:31:53.527017 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:53.526967 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs podName:22897615-e1fd-4eb7-9694-81b23695e7a5 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:01.526947511 +0000 UTC m=+17.083863384 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs") pod "network-metrics-daemon-7s68w" (UID: "22897615-e1fd-4eb7-9694-81b23695e7a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:31:53.527391 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:53.527363 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:31:53.527490 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:53.527420 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret podName:7ca81320-80de-485a-8225-cc323e3cefc8 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:01.527403184 +0000 UTC m=+17.084319057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret") pod "global-pull-secret-syncer-2p6b9" (UID: "7ca81320-80de-485a-8225-cc323e3cefc8") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:31:53.728294 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:53.728253 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjqh\" (UniqueName: \"kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh\") pod \"network-check-target-k7w5x\" (UID: \"33267e5b-9b26-472f-8b36-6fc795d5131d\") " pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:31:53.728469 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:53.728448 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:31:53.728547 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:53.728478 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:31:53.728547 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:53.728492 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xwjqh for pod openshift-network-diagnostics/network-check-target-k7w5x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:31:53.728629 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:53.728571 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh podName:33267e5b-9b26-472f-8b36-6fc795d5131d nodeName:}" failed. No retries permitted until 2026-07-24 14:32:01.728548745 +0000 UTC m=+17.285464622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwjqh" (UniqueName: "kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh") pod "network-check-target-k7w5x" (UID: "33267e5b-9b26-472f-8b36-6fc795d5131d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:31:53.966407 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:53.966365 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:31:53.966878 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:53.966413 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:53.966878 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:53.966495 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:31:53.966878 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:53.966629 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:31:54.966580 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:54.966552 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:54.967017 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:54.966660 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:31:55.966509 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:55.966474 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:31:55.966711 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:55.966484 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:55.966711 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:55.966610 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:31:55.966711 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:55.966683 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:31:56.966709 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:56.966674 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:56.967140 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:56.966805 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:31:57.965948 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:57.965910 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:57.966124 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:57.965910 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:31:57.966124 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:57.966077 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:31:57.966205 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:57.966146 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:31:58.966153 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:58.965919 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:31:58.966153 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:58.966036 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:31:59.965724 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:59.965686 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:31:59.965890 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:31:59.965744 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:31:59.965890 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:59.965845 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:31:59.966005 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:31:59.965974 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:32:00.966389 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:00.966352 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:32:00.966875 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:00.966478 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:32:01.584745 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:01.584707 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs\") pod \"network-metrics-daemon-7s68w\" (UID: \"22897615-e1fd-4eb7-9694-81b23695e7a5\") " pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:32:01.584968 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:01.584772 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret\") pod \"global-pull-secret-syncer-2p6b9\" (UID: \"7ca81320-80de-485a-8225-cc323e3cefc8\") " pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:32:01.584968 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:01.584861 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:32:01.584968 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:01.584948 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs podName:22897615-e1fd-4eb7-9694-81b23695e7a5 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:17.584928077 +0000 UTC m=+33.141843969 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs") pod "network-metrics-daemon-7s68w" (UID: "22897615-e1fd-4eb7-9694-81b23695e7a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:32:01.584968 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:01.584867 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:32:01.585186 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:01.585009 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret podName:7ca81320-80de-485a-8225-cc323e3cefc8 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:17.584995482 +0000 UTC m=+33.141911353 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret") pod "global-pull-secret-syncer-2p6b9" (UID: "7ca81320-80de-485a-8225-cc323e3cefc8") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:32:01.785585 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:01.785551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjqh\" (UniqueName: \"kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh\") pod \"network-check-target-k7w5x\" (UID: \"33267e5b-9b26-472f-8b36-6fc795d5131d\") " pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:01.785788 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:01.785696 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:32:01.785788 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:01.785713 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:32:01.785788 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:01.785722 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xwjqh for pod openshift-network-diagnostics/network-check-target-k7w5x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:32:01.785788 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:01.785779 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh podName:33267e5b-9b26-472f-8b36-6fc795d5131d nodeName:}" failed. No retries permitted until 2026-07-24 14:32:17.785761023 +0000 UTC m=+33.342676920 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwjqh" (UniqueName: "kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh") pod "network-check-target-k7w5x" (UID: "33267e5b-9b26-472f-8b36-6fc795d5131d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:32:01.966446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:01.966363 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:32:01.966446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:01.966386 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:01.966879 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:01.966485 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:32:01.966879 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:01.966608 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:32:02.966129 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:02.966094 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:32:02.966296 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:02.966220 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:32:03.966064 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:03.966022 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:03.966501 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:03.966073 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:32:03.966501 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:03.966164 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:32:03.966501 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:03.966265 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:32:04.967270 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:04.967067 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:32:04.967741 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:04.967353 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:32:05.965922 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:05.965835 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:32:05.966076 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:05.965972 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:32:05.966076 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:05.966018 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:05.966186 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:05.966113 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:32:06.121211 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:06.121138 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-64.ec2.internal" event={"ID":"4771bee4c620d4964602556291e24ed3","Type":"ContainerStarted","Data":"5f456c2a849a8f345d14d5572b938e4f77f892a6150de2c8a937eeaf2e875c25"} Jul 24 14:32:06.125244 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:06.124743 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vwgvc" event={"ID":"38648634-ad37-495e-993d-e18db1878323","Type":"ContainerStarted","Data":"743fa755fe78f8d452e32559f8e6bbd32e4a1f71892c5667cbd8ebc768d26f3b"} Jul 24 14:32:06.128916 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:06.128884 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w4274" event={"ID":"6813ce9b-a924-40a0-8ee8-41e50e4a9e7c","Type":"ContainerStarted","Data":"21261fcfef6e505dc270c82b6ff56b84bb690728851ad5ec6391fea727aef2bf"} Jul 24 14:32:06.135109 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:06.135058 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-64.ec2.internal" podStartSLOduration=21.135039845 podStartE2EDuration="21.135039845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:31:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:06.134693607 +0000 UTC m=+21.691609500" watchObservedRunningTime="2026-07-24 14:32:06.135039845 +0000 UTC m=+21.691955738" Jul 24 14:32:06.160220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:06.160177 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vwgvc" podStartSLOduration=1.922352432 podStartE2EDuration="21.160161816s" totalImagesPullingTime="19.237809384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:06.16002219 +0000 UTC m=+21.716938082" watchObservedRunningTime="2026-07-24 14:32:06.160161816 +0000 UTC m=+21.717077707" Jul 24 14:32:06.160348 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:06.160332 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w4274" podStartSLOduration=1.839197844 podStartE2EDuration="21.160326197s" totalImagesPullingTime="19.321128353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:06.147267549 +0000 UTC m=+21.704183421" watchObservedRunningTime="2026-07-24 14:32:06.160326197 +0000 UTC m=+21.717242088" Jul 24 14:32:06.966394 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:06.966082 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:32:06.966545 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:06.966485 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:32:07.134436 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.134409 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 14:32:07.135342 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.134796 2581 generic.go:356] "Generic (PLEG): container finished" podID="28c3edc3-9454-48a6-b3fa-bcde5f0666f5" containerID="c65a7270833296a09c510205f206e5e3f4510f1b8ccc2fe45cbaadfcdb1c9b49" exitCode=1 Jul 24 14:32:07.135342 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.134873 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" event={"ID":"28c3edc3-9454-48a6-b3fa-bcde5f0666f5","Type":"ContainerStarted","Data":"72436a82affbe86ca402ed16bf913f92bbd82053559b875c65339dce01173817"} Jul 24 14:32:07.135342 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.134956 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" event={"ID":"28c3edc3-9454-48a6-b3fa-bcde5f0666f5","Type":"ContainerStarted","Data":"247e3cef9f6782ce73527f05035a6e1cdfc2ffbe0dfe06e8162ffab87572cc5b"} Jul 24 14:32:07.135342 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.135003 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" event={"ID":"28c3edc3-9454-48a6-b3fa-bcde5f0666f5","Type":"ContainerStarted","Data":"4627f1cd809df313888927518aa1e87b73ecfe722c3766b91b1e6124210d3b19"} Jul 24 14:32:07.135342 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.135045 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" event={"ID":"28c3edc3-9454-48a6-b3fa-bcde5f0666f5","Type":"ContainerStarted","Data":"557c5f13ee1722e95219675bc44043f412a0833d1bcece5e1c0d1354757e9b35"} Jul 24 14:32:07.135342 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.135095 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" event={"ID":"28c3edc3-9454-48a6-b3fa-bcde5f0666f5","Type":"ContainerDied","Data":"c65a7270833296a09c510205f206e5e3f4510f1b8ccc2fe45cbaadfcdb1c9b49"} Jul 24 14:32:07.135342 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.135149 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" event={"ID":"28c3edc3-9454-48a6-b3fa-bcde5f0666f5","Type":"ContainerStarted","Data":"14c09300f188b9ab8eea9a5cd75d79d881951770560a225a96afbbaf239efd94"} Jul 24 14:32:07.136572 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.136546 2581 generic.go:356] "Generic (PLEG): container finished" podID="a1494d17fecc8d5a3360ffd411040120" containerID="e476a372698284fd091642713cc413e2ab3f8df62cd88f41e0ee331f810291f9" exitCode=0 Jul 24 14:32:07.136690 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.136623 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal" event={"ID":"a1494d17fecc8d5a3360ffd411040120","Type":"ContainerDied","Data":"e476a372698284fd091642713cc413e2ab3f8df62cd88f41e0ee331f810291f9"} Jul 24 14:32:07.138292 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.138267 2581 generic.go:356] "Generic (PLEG): container finished" podID="f801522b-b504-4771-bfd2-0f4f0d52affd" containerID="93847d450ee0755441905f0fc8f6c5dd2b5808a84cee0dc0b31f4bdd5368651a" exitCode=0 Jul 24 14:32:07.138414 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.138361 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx2c" event={"ID":"f801522b-b504-4771-bfd2-0f4f0d52affd","Type":"ContainerDied","Data":"93847d450ee0755441905f0fc8f6c5dd2b5808a84cee0dc0b31f4bdd5368651a"} Jul 24 14:32:07.140640 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.140619 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wsdqx" event={"ID":"7703c0af-9df4-4f61-980a-558ccfe28fee","Type":"ContainerStarted","Data":"c6902bce0ea83646ca46df3f8deac2675a92dec0a8c203a6db3ddf69a130a683"} Jul 24 14:32:07.142255 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.142235 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" event={"ID":"d5866f23-6b47-4d0e-943e-017a1de7d581","Type":"ContainerStarted","Data":"99cf0f2ae35dadbc6e6f86b7d0e8b9bdced7a50faa5440e5d2e40aaddb17e21c"} Jul 24 14:32:07.143701 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.143674 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-56q9x" event={"ID":"b4d6c94a-3563-496b-b628-4f22549d7b44","Type":"ContainerStarted","Data":"f939dc9e66fe408599e73149bb87307eb144ee30fd7c24c0e3d7d95d6bc24286"} Jul 24 14:32:07.145090 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.145068 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gbj8p" event={"ID":"e46c7c4a-495c-4166-b129-ddb313b4731b","Type":"ContainerStarted","Data":"c50ae8856d3211588ea33d2c75b06fd0aa119b4be4da7a62e3dd1f5a21328989"} Jul 24 14:32:07.181599 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.181543 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-56q9x" podStartSLOduration=2.868509326 podStartE2EDuration="22.181506512s" totalImagesPullingTime="19.312997186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:07.18101481 +0000 UTC m=+22.737930702" watchObservedRunningTime="2026-07-24 14:32:07.181506512 +0000 UTC m=+22.738422405" Jul 24 14:32:07.195651 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.195600 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gbj8p" podStartSLOduration=7.371509985 podStartE2EDuration="22.195580403s" totalImagesPullingTime="14.824070418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:07.19516012 +0000 UTC m=+22.752076013" watchObservedRunningTime="2026-07-24 14:32:07.195580403 +0000 UTC m=+22.752496296" Jul 24 14:32:07.210179 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.210136 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wsdqx" podStartSLOduration=2.968353735 podStartE2EDuration="22.210123149s" totalImagesPullingTime="19.241769414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:07.210026156 +0000 UTC m=+22.766942050" watchObservedRunningTime="2026-07-24 14:32:07.210123149 +0000 UTC m=+22.767039037" Jul 24 14:32:07.861632 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.861607 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 14:32:07.932057 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.931957 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T14:32:07.861625749Z","UUID":"6a40180e-6542-4af9-8e88-067d3186d9cd","Handler":null,"Name":"","Endpoint":""} Jul 24 14:32:07.933543 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.933503 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 14:32:07.933671 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.933560 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 14:32:07.966228 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.966196 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:32:07.966394 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:07.966317 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:32:07.966394 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:07.966346 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:07.966507 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:07.966425 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:32:08.150762 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:08.150726 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal" event={"ID":"a1494d17fecc8d5a3360ffd411040120","Type":"ContainerStarted","Data":"e24f4363c7e339e853a08079535ee0852247e2de4b825d82186bcaba62fe6c6a"} Jul 24 14:32:08.152945 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:08.152919 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" event={"ID":"d5866f23-6b47-4d0e-943e-017a1de7d581","Type":"ContainerStarted","Data":"00c0a0dd3e47ea1e133bf4fde8c61b5049bcb44ae5e34ed713f7647971269304"} Jul 24 14:32:08.172629 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:08.170814 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-64.ec2.internal" podStartSLOduration=23.170788632 podStartE2EDuration="23.170788632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:31:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:08.169850004 +0000 UTC m=+23.726765897" watchObservedRunningTime="2026-07-24 14:32:08.170788632 +0000 UTC m=+23.727704526" Jul 24 14:32:08.966363 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:08.965749 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:32:08.966363 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:08.965898 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:32:09.157410 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:09.157375 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" event={"ID":"d5866f23-6b47-4d0e-943e-017a1de7d581","Type":"ContainerStarted","Data":"1d5ac6f06cc24dd77eb47ebeed555e930c1ce50c44bf8e20887069686b0bab23"} Jul 24 14:32:09.161004 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:09.160983 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 14:32:09.161866 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:09.161685 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" event={"ID":"28c3edc3-9454-48a6-b3fa-bcde5f0666f5","Type":"ContainerStarted","Data":"b7f142a29639a9365cf170e8475769778e8464d5d1f4ff51babfb89e012cfc93"} Jul 24 14:32:09.177178 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:09.177125 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5wrz" podStartSLOduration=2.489653131 podStartE2EDuration="24.177111519s" totalImagesPullingTime="21.687458388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:31:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:09.176141271 +0000 UTC m=+24.733057162" watchObservedRunningTime="2026-07-24 14:32:09.177111519 +0000 UTC m=+24.734027408" Jul 24 14:32:09.966604 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:09.966383 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:09.966784 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:09.966413 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:32:09.966784 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:09.966689 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:32:09.966909 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:09.966796 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:32:10.966584 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:10.966551 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:32:10.967019 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:10.966690 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:32:11.306699 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:11.306664 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gbj8p" Jul 24 14:32:11.307395 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:11.307375 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gbj8p" Jul 24 14:32:11.966032 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:11.965998 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:32:11.966183 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:11.966128 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:32:11.966183 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:11.966172 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:11.966303 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:11.966260 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:32:12.170602 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:12.170368 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx2c" event={"ID":"f801522b-b504-4771-bfd2-0f4f0d52affd","Type":"ContainerStarted","Data":"fdf60a8180fdca1b853d7c27b588e84afa3de605f572f7e2ca7b45c6d16b2dd8"} Jul 24 14:32:12.173576 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:12.173555 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 14:32:12.173985 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:12.173962 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" event={"ID":"28c3edc3-9454-48a6-b3fa-bcde5f0666f5","Type":"ContainerStarted","Data":"a7e4a2fc6a85d1196a1f8322c2d70e8391bc32e48dee0b884665eae2ec3f5bb8"} Jul 24 14:32:12.174166 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:12.174149 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gbj8p" Jul 24 14:32:12.174509 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:12.174487 2581 scope.go:117] "RemoveContainer" containerID="c65a7270833296a09c510205f206e5e3f4510f1b8ccc2fe45cbaadfcdb1c9b49" Jul 24 14:32:12.174641 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:12.174627 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gbj8p" Jul 24 14:32:12.965732 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:12.965701 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:32:12.966007 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:12.965825 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:32:13.181272 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:13.181228 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 14:32:13.181826 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:13.181798 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" event={"ID":"28c3edc3-9454-48a6-b3fa-bcde5f0666f5","Type":"ContainerStarted","Data":"9a9b24cf255772457dd23e148bf94f21a2bb54a6a40b1aab94dd4de18a2a6cdf"} Jul 24 14:32:13.182062 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:13.182038 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:32:13.182224 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:13.182204 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:32:13.182328 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:13.182278 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:32:13.183889 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:13.183862 2581 generic.go:356] "Generic (PLEG): container finished" podID="f801522b-b504-4771-bfd2-0f4f0d52affd" containerID="fdf60a8180fdca1b853d7c27b588e84afa3de605f572f7e2ca7b45c6d16b2dd8" exitCode=0 Jul 24 14:32:13.184001 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:13.183940 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx2c" event={"ID":"f801522b-b504-4771-bfd2-0f4f0d52affd","Type":"ContainerDied","Data":"fdf60a8180fdca1b853d7c27b588e84afa3de605f572f7e2ca7b45c6d16b2dd8"} Jul 24 14:32:13.198811 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:13.198784 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:32:13.200050 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:13.200027 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:32:13.212063 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:13.212022 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" podStartSLOduration=8.345183978 podStartE2EDuration="28.212010394s" totalImagesPullingTime="19.866826416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:13.210483173 +0000 UTC m=+28.767399065" watchObservedRunningTime="2026-07-24 14:32:13.212010394 +0000 UTC m=+28.768926285" Jul 24 14:32:13.965942 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:13.965908 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:32:13.966115 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:13.966017 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:32:13.966115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:13.966082 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:13.966296 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:13.966208 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:32:14.142833 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:14.142798 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7s68w"] Jul 24 14:32:14.143408 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:14.143380 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2p6b9"] Jul 24 14:32:14.143565 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:14.143487 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:32:14.143632 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:14.143591 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:32:14.144192 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:14.144168 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k7w5x"] Jul 24 14:32:14.186459 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:14.186438 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:32:14.186896 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:14.186437 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:14.186896 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:14.186555 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:32:14.187007 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:14.186986 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:32:15.190780 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:15.190739 2581 generic.go:356] "Generic (PLEG): container finished" podID="f801522b-b504-4771-bfd2-0f4f0d52affd" containerID="da1c20286f4a23d1a19e2ba6455f1a5c452fd7f099c9b26bf201fe3910b27179" exitCode=0 Jul 24 14:32:15.191136 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:15.190827 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx2c" event={"ID":"f801522b-b504-4771-bfd2-0f4f0d52affd","Type":"ContainerDied","Data":"da1c20286f4a23d1a19e2ba6455f1a5c452fd7f099c9b26bf201fe3910b27179"} Jul 24 14:32:15.966051 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:15.965791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:32:15.966226 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:15.965814 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:32:15.966226 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:15.966152 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:32:15.966226 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:15.965816 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:15.966226 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:15.966208 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:32:15.966460 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:15.966262 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:32:17.197127 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:17.197091 2581 generic.go:356] "Generic (PLEG): container finished" podID="f801522b-b504-4771-bfd2-0f4f0d52affd" containerID="62b4056ec15e47cd23d84be61167551fa9b6bcbe3032928b51c314b3ebd0790e" exitCode=0 Jul 24 14:32:17.197490 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:17.197147 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx2c" event={"ID":"f801522b-b504-4771-bfd2-0f4f0d52affd","Type":"ContainerDied","Data":"62b4056ec15e47cd23d84be61167551fa9b6bcbe3032928b51c314b3ebd0790e"} Jul 24 14:32:17.600428 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:17.600399 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs\") pod \"network-metrics-daemon-7s68w\" (UID: \"22897615-e1fd-4eb7-9694-81b23695e7a5\") " pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:32:17.600593 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:17.600435 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret\") pod \"global-pull-secret-syncer-2p6b9\" (UID: \"7ca81320-80de-485a-8225-cc323e3cefc8\") " pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:32:17.600593 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:17.600546 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:32:17.600593 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:17.600548 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:32:17.600703 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:17.600602 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret podName:7ca81320-80de-485a-8225-cc323e3cefc8 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:49.600586992 +0000 UTC m=+65.157502865 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret") pod "global-pull-secret-syncer-2p6b9" (UID: "7ca81320-80de-485a-8225-cc323e3cefc8") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:32:17.600703 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:17.600617 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs podName:22897615-e1fd-4eb7-9694-81b23695e7a5 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:49.600611262 +0000 UTC m=+65.157527132 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs") pod "network-metrics-daemon-7s68w" (UID: "22897615-e1fd-4eb7-9694-81b23695e7a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:32:17.801285 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:17.801253 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjqh\" (UniqueName: \"kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh\") pod \"network-check-target-k7w5x\" (UID: \"33267e5b-9b26-472f-8b36-6fc795d5131d\") " pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:17.801470 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:17.801378 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:32:17.801470 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:17.801396 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:32:17.801470 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:17.801405 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xwjqh for pod openshift-network-diagnostics/network-check-target-k7w5x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:32:17.801470 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:17.801447 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh podName:33267e5b-9b26-472f-8b36-6fc795d5131d nodeName:}" failed. No retries permitted until 2026-07-24 14:32:49.801434761 +0000 UTC m=+65.358350631 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwjqh" (UniqueName: "kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh") pod "network-check-target-k7w5x" (UID: "33267e5b-9b26-472f-8b36-6fc795d5131d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:32:17.966110 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:17.966022 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:32:17.966110 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:17.966062 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:32:17.966110 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:17.966066 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:17.966315 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:17.966140 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s68w" podUID="22897615-e1fd-4eb7-9694-81b23695e7a5" Jul 24 14:32:17.966315 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:17.966216 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2p6b9" podUID="7ca81320-80de-485a-8225-cc323e3cefc8" Jul 24 14:32:17.966315 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:17.966274 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7w5x" podUID="33267e5b-9b26-472f-8b36-6fc795d5131d" Jul 24 14:32:19.714354 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.714281 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-64.ec2.internal" event="NodeReady" Jul 24 14:32:19.714827 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.714418 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 14:32:19.756381 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.756226 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bbb7bd6cb-99gms"] Jul 24 14:32:19.759761 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.759740 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.762731 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.762702 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 24 14:32:19.762961 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.762940 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 24 14:32:19.763072 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.762942 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2hm46\"" Jul 24 14:32:19.763293 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.763274 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 24 14:32:19.769740 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.769722 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 24 14:32:19.772573 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.772546 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw"] Jul 24 14:32:19.776163 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.776139 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w"] Jul 24 14:32:19.776509 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.776431 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" Jul 24 14:32:19.779330 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.779307 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 24 14:32:19.780387 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.780368 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x2ndk"] Jul 24 14:32:19.780507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.780492 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w" Jul 24 14:32:19.783361 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.783340 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:32:19.783582 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.783564 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-jx44r"] Jul 24 14:32:19.783678 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.783618 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x2ndk" Jul 24 14:32:19.788436 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.788387 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:32:19.788436 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.788391 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 24 14:32:19.788660 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.788574 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kwj8h\"" Jul 24 14:32:19.788660 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.788636 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 24 14:32:19.788835 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.788815 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 24 14:32:19.788922 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.788833 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:32:19.789028 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.789016 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-55c8f8654c-n89nb"] Jul 24 14:32:19.789086 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.789073 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-r24f9\"" Jul 24 14:32:19.789136 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.789123 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:19.789188 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.789142 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 24 14:32:19.789242 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.789221 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-crrl7\"" Jul 24 14:32:19.789345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.789146 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 24 14:32:19.792079 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.792062 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc"] Jul 24 14:32:19.792225 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.792176 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:19.792342 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.792237 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 14:32:19.792851 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.792832 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-k75t6\"" Jul 24 14:32:19.792959 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.792865 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 24 14:32:19.792959 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.792933 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 14:32:19.793106 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.793080 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 24 14:32:19.795002 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.794984 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4"] Jul 24 14:32:19.795126 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.795102 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc" Jul 24 14:32:19.797765 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.797744 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 24 14:32:19.797981 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.797962 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-pn96s"] Jul 24 14:32:19.798091 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.798076 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:19.799208 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.799193 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:32:19.799471 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.799450 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 24 14:32:19.799572 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.799477 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 24 14:32:19.799572 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.799490 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 24 14:32:19.799572 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.799497 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 24 14:32:19.799755 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.799481 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 24 14:32:19.799755 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.799490 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-d7dwf\"" Jul 24 14:32:19.799755 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.799741 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 24 14:32:19.799910 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.799894 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 24 14:32:19.799967 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.799957 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-k95cr\"" Jul 24 14:32:19.800829 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.800810 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bbb7bd6cb-99gms"] Jul 24 14:32:19.800938 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.800898 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:32:19.801810 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.801793 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 24 14:32:19.803016 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.803001 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 24 14:32:19.803374 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.803352 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nlj9q\"" Jul 24 14:32:19.803488 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.803469 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 14:32:19.803566 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.803483 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 14:32:19.803967 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.803948 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 24 14:32:19.804070 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.803997 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:32:19.804152 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.804000 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 24 14:32:19.805636 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.805377 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 24 14:32:19.805818 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.805780 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-q5zsw\"" Jul 24 14:32:19.808373 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.805998 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 24 14:32:19.808373 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.807085 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4"] Jul 24 14:32:19.808373 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.807831 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc"] Jul 24 14:32:19.808704 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.808684 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 24 14:32:19.808992 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.808969 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w"] Jul 24 14:32:19.811380 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.811361 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55c8f8654c-n89nb"] Jul 24 14:32:19.813072 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.813041 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-jx44r"] Jul 24 14:32:19.813612 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.813579 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 24 14:32:19.813721 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.813658 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw"] Jul 24 14:32:19.813932 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.813912 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-certificates\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.814028 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.814008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-trusted-ca\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.814087 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.814045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-bound-sa-token\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.814142 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.814087 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-installation-pull-secrets\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.814745 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.814143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-ca-trust-extracted\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.814745 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.814173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-image-registry-private-configuration\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.814745 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.814200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.814745 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.814226 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbr7h\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-kube-api-access-vbr7h\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.825657 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.825638 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-6ps6n"] Jul 24 14:32:19.829639 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.829486 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zc6bp"] Jul 24 14:32:19.829779 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.829759 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6ps6n" Jul 24 14:32:19.832104 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.832082 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-545zd\"" Jul 24 14:32:19.832216 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.832082 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 14:32:19.832699 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.832677 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x2ndk"] Jul 24 14:32:19.832812 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.832720 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-pn96s"] Jul 24 14:32:19.832812 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.832777 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zc6bp" Jul 24 14:32:19.833182 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.833161 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 14:32:19.835503 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.835482 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 14:32:19.836630 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.836607 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 14:32:19.836630 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.836628 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lb5b6\"" Jul 24 14:32:19.836954 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.836934 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 14:32:19.842559 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.842522 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-6ps6n"] Jul 24 14:32:19.845012 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.844990 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zc6bp"] Jul 24 14:32:19.876613 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.876587 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mc5kt"] Jul 24 14:32:19.879866 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.879848 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:19.882905 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.882884 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 14:32:19.883001 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.882951 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 14:32:19.883360 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.883159 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 14:32:19.883360 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.883196 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m2jtv\"" Jul 24 14:32:19.883499 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.883422 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 14:32:19.896483 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.896460 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mc5kt"] Jul 24 14:32:19.915579 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.915552 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2b7h\" (UniqueName: \"kubernetes.io/projected/8a792e60-4287-43e9-ba89-8f35e981b6fe-kube-api-access-d2b7h\") pod \"network-check-source-7d88cb55d8-6ps6n\" (UID: \"8a792e60-4287-43e9-ba89-8f35e981b6fe\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6ps6n" Jul 24 14:32:19.915727 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.915593 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ba79270-3bec-4c43-97f2-3313aed19503-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:19.915727 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.915620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snvgk\" (UniqueName: \"kubernetes.io/projected/22f5a108-29e1-475b-a485-f5b42c371cb9-kube-api-access-snvgk\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:19.915727 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.915670 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-certificates\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.915891 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.915724 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-default-certificate\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:19.915891 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.915784 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eeddf5b7-07cf-421b-a168-5b67bbb239f1-config\") pod \"console-operator-584dcb6b54-pn96s\" (UID: \"eeddf5b7-07cf-421b-a168-5b67bbb239f1\") " pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:32:19.915891 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.915831 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b40cdad-7cb1-4132-9498-356e139cde9a-cert\") pod \"ingress-canary-zc6bp\" (UID: \"9b40cdad-7cb1-4132-9498-356e139cde9a\") " pod="openshift-ingress-canary/ingress-canary-zc6bp" Jul 24 14:32:19.915891 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.915858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m72p4\" (UID: \"d002916e-5145-4d9a-b074-a5f1ef2a1194\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:19.915891 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.915890 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-bound-sa-token\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.916123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.915942 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-image-registry-private-configuration\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.916123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.915976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldgxl\" (UniqueName: \"kubernetes.io/projected/4b150ceb-025b-45ad-9bca-e9a274b0c418-kube-api-access-ldgxl\") pod \"volume-data-source-validator-549c6d54cf-x2ndk\" (UID: \"4b150ceb-025b-45ad-9bca-e9a274b0c418\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x2ndk" Jul 24 14:32:19.916123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.915999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:19.916123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916046 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eeddf5b7-07cf-421b-a168-5b67bbb239f1-trusted-ca\") pod \"console-operator-584dcb6b54-pn96s\" (UID: \"eeddf5b7-07cf-421b-a168-5b67bbb239f1\") " pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:32:19.916123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qfnzw\" (UID: \"fded2848-bd46-4040-94c3-ac7b1a47126b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" Jul 24 14:32:19.916123 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916121 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/34244aba-7d82-4b4e-aac5-216ee4e6bbaa-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w\" (UID: \"34244aba-7d82-4b4e-aac5-216ee4e6bbaa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w" Jul 24 14:32:19.916389 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ba79270-3bec-4c43-97f2-3313aed19503-tmp\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:19.916389 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916159 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f122507-6dec-43f9-872f-fba90dbc59ea-config\") pod \"service-ca-operator-5d6c75f84f-x75xc\" (UID: \"0f122507-6dec-43f9-872f-fba90dbc59ea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc" Jul 24 14:32:19.916389 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916178 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s4bq\" (UniqueName: \"kubernetes.io/projected/d002916e-5145-4d9a-b074-a5f1ef2a1194-kube-api-access-7s4bq\") pod \"cluster-monitoring-operator-548b489cb8-m72p4\" (UID: \"d002916e-5145-4d9a-b074-a5f1ef2a1194\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:19.916389 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916206 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-stats-auth\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:19.916389 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916232 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfhs5\" (UniqueName: \"kubernetes.io/projected/9b40cdad-7cb1-4132-9498-356e139cde9a-kube-api-access-rfhs5\") pod \"ingress-canary-zc6bp\" (UID: \"9b40cdad-7cb1-4132-9498-356e139cde9a\") " pod="openshift-ingress-canary/ingress-canary-zc6bp" Jul 24 14:32:19.916389 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916249 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-certificates\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.916389 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d002916e-5145-4d9a-b074-a5f1ef2a1194-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-m72p4\" (UID: \"d002916e-5145-4d9a-b074-a5f1ef2a1194\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:19.916389 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916304 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f2j5\" (UniqueName: \"kubernetes.io/projected/0f122507-6dec-43f9-872f-fba90dbc59ea-kube-api-access-4f2j5\") pod \"service-ca-operator-5d6c75f84f-x75xc\" (UID: \"0f122507-6dec-43f9-872f-fba90dbc59ea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc" Jul 24 14:32:19.916389 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f122507-6dec-43f9-872f-fba90dbc59ea-serving-cert\") pod \"service-ca-operator-5d6c75f84f-x75xc\" (UID: \"0f122507-6dec-43f9-872f-fba90dbc59ea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc" Jul 24 14:32:19.916389 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916355 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/34244aba-7d82-4b4e-aac5-216ee4e6bbaa-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w\" (UID: \"34244aba-7d82-4b4e-aac5-216ee4e6bbaa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w" Jul 24 14:32:19.916389 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916376 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1ba79270-3bec-4c43-97f2-3313aed19503-serving-cert\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:19.916902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-trusted-ca\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.916902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916424 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1ba79270-3bec-4c43-97f2-3313aed19503-snapshots\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:19.916902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916563 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks79l\" (UniqueName: \"kubernetes.io/projected/fded2848-bd46-4040-94c3-ac7b1a47126b-kube-api-access-ks79l\") pod \"cluster-samples-operator-6748489656-qfnzw\" (UID: \"fded2848-bd46-4040-94c3-ac7b1a47126b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" Jul 24 14:32:19.916902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-installation-pull-secrets\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.916902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbr7h\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-kube-api-access-vbr7h\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.916902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916680 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75b55\" (UniqueName: \"kubernetes.io/projected/1ba79270-3bec-4c43-97f2-3313aed19503-kube-api-access-75b55\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:19.916902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eeddf5b7-07cf-421b-a168-5b67bbb239f1-serving-cert\") pod \"console-operator-584dcb6b54-pn96s\" (UID: \"eeddf5b7-07cf-421b-a168-5b67bbb239f1\") " pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:32:19.916902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916746 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-ca-trust-extracted\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.916902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916770 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8fbt\" (UniqueName: \"kubernetes.io/projected/eeddf5b7-07cf-421b-a168-5b67bbb239f1-kube-api-access-z8fbt\") pod \"console-operator-584dcb6b54-pn96s\" (UID: \"eeddf5b7-07cf-421b-a168-5b67bbb239f1\") " pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:32:19.916902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.916902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916824 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69cs8\" (UniqueName: \"kubernetes.io/projected/34244aba-7d82-4b4e-aac5-216ee4e6bbaa-kube-api-access-69cs8\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w\" (UID: \"34244aba-7d82-4b4e-aac5-216ee4e6bbaa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w" Jul 24 14:32:19.916902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916869 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:19.916902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.916893 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ba79270-3bec-4c43-97f2-3313aed19503-service-ca-bundle\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:19.917354 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:19.917027 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 14:32:19.917354 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:19.917045 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bbb7bd6cb-99gms: secret "image-registry-tls" not found Jul 24 14:32:19.917354 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:19.917119 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls podName:c3d6f109-433f-4b97-b6f7-b42bb7cc79cf nodeName:}" failed. No retries permitted until 2026-07-24 14:32:20.417105879 +0000 UTC m=+35.974021750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls") pod "image-registry-6bbb7bd6cb-99gms" (UID: "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf") : secret "image-registry-tls" not found Jul 24 14:32:19.917354 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.917240 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-ca-trust-extracted\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.917501 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.917410 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-trusted-ca\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.920988 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.920965 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-image-registry-private-configuration\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.920988 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.920983 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-installation-pull-secrets\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.924966 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.924918 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbj8p_e46c7c4a-495c-4166-b129-ddb313b4731b/konnectivity-agent/0.log" limit=1024 Jul 24 14:32:19.940556 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.940513 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-bound-sa-token\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.942644 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.942620 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbr7h\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-kube-api-access-vbr7h\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:19.966701 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.966631 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:32:19.966701 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.966652 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:32:19.966886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.966751 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:19.969683 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.969654 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tpbrb\"" Jul 24 14:32:19.969808 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.969712 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljg7j\"" Jul 24 14:32:19.969808 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.969712 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 14:32:19.969808 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:19.969791 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 14:32:20.017925 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.017897 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-stats-auth\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:20.017925 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.017928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfhs5\" (UniqueName: \"kubernetes.io/projected/9b40cdad-7cb1-4132-9498-356e139cde9a-kube-api-access-rfhs5\") pod \"ingress-canary-zc6bp\" (UID: \"9b40cdad-7cb1-4132-9498-356e139cde9a\") " pod="openshift-ingress-canary/ingress-canary-zc6bp" Jul 24 14:32:20.018115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.017947 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d002916e-5145-4d9a-b074-a5f1ef2a1194-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-m72p4\" (UID: \"d002916e-5145-4d9a-b074-a5f1ef2a1194\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:20.018115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.017966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f2j5\" (UniqueName: \"kubernetes.io/projected/0f122507-6dec-43f9-872f-fba90dbc59ea-kube-api-access-4f2j5\") pod \"service-ca-operator-5d6c75f84f-x75xc\" (UID: \"0f122507-6dec-43f9-872f-fba90dbc59ea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc" Jul 24 14:32:20.018115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f122507-6dec-43f9-872f-fba90dbc59ea-serving-cert\") pod \"service-ca-operator-5d6c75f84f-x75xc\" (UID: \"0f122507-6dec-43f9-872f-fba90dbc59ea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc" Jul 24 14:32:20.018115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018043 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/34244aba-7d82-4b4e-aac5-216ee4e6bbaa-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w\" (UID: \"34244aba-7d82-4b4e-aac5-216ee4e6bbaa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w" Jul 24 14:32:20.018115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018072 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:20.018115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1ba79270-3bec-4c43-97f2-3313aed19503-serving-cert\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:20.018362 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1ba79270-3bec-4c43-97f2-3313aed19503-snapshots\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:20.018362 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018152 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks79l\" (UniqueName: \"kubernetes.io/projected/fded2848-bd46-4040-94c3-ac7b1a47126b-kube-api-access-ks79l\") pod \"cluster-samples-operator-6748489656-qfnzw\" (UID: \"fded2848-bd46-4040-94c3-ac7b1a47126b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" Jul 24 14:32:20.018362 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxkq5\" (UniqueName: \"kubernetes.io/projected/e2238818-2359-4792-9170-4294d907f0dc-kube-api-access-kxkq5\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:20.018362 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018214 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75b55\" (UniqueName: \"kubernetes.io/projected/1ba79270-3bec-4c43-97f2-3313aed19503-kube-api-access-75b55\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:20.018362 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018255 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eeddf5b7-07cf-421b-a168-5b67bbb239f1-serving-cert\") pod \"console-operator-584dcb6b54-pn96s\" (UID: \"eeddf5b7-07cf-421b-a168-5b67bbb239f1\") " pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:32:20.018362 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018286 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8fbt\" (UniqueName: \"kubernetes.io/projected/eeddf5b7-07cf-421b-a168-5b67bbb239f1-kube-api-access-z8fbt\") pod \"console-operator-584dcb6b54-pn96s\" (UID: \"eeddf5b7-07cf-421b-a168-5b67bbb239f1\") " pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:32:20.018362 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69cs8\" (UniqueName: \"kubernetes.io/projected/34244aba-7d82-4b4e-aac5-216ee4e6bbaa-kube-api-access-69cs8\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w\" (UID: \"34244aba-7d82-4b4e-aac5-216ee4e6bbaa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w" Jul 24 14:32:20.018362 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018361 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:20.018814 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018387 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ba79270-3bec-4c43-97f2-3313aed19503-service-ca-bundle\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:20.018814 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018426 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2b7h\" (UniqueName: \"kubernetes.io/projected/8a792e60-4287-43e9-ba89-8f35e981b6fe-kube-api-access-d2b7h\") pod \"network-check-source-7d88cb55d8-6ps6n\" (UID: \"8a792e60-4287-43e9-ba89-8f35e981b6fe\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6ps6n" Jul 24 14:32:20.018814 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018455 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2238818-2359-4792-9170-4294d907f0dc-tmp-dir\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:20.018814 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018499 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ba79270-3bec-4c43-97f2-3313aed19503-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:20.018814 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018546 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snvgk\" (UniqueName: \"kubernetes.io/projected/22f5a108-29e1-475b-a485-f5b42c371cb9-kube-api-access-snvgk\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:20.018814 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018578 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2238818-2359-4792-9170-4294d907f0dc-config-volume\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:20.018814 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-default-certificate\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:20.018814 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eeddf5b7-07cf-421b-a168-5b67bbb239f1-config\") pod \"console-operator-584dcb6b54-pn96s\" (UID: \"eeddf5b7-07cf-421b-a168-5b67bbb239f1\") " pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:32:20.018814 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b40cdad-7cb1-4132-9498-356e139cde9a-cert\") pod \"ingress-canary-zc6bp\" (UID: \"9b40cdad-7cb1-4132-9498-356e139cde9a\") " pod="openshift-ingress-canary/ingress-canary-zc6bp" Jul 24 14:32:20.018814 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018713 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m72p4\" (UID: \"d002916e-5145-4d9a-b074-a5f1ef2a1194\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:20.019305 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.018926 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d002916e-5145-4d9a-b074-a5f1ef2a1194-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-m72p4\" (UID: \"d002916e-5145-4d9a-b074-a5f1ef2a1194\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:20.019305 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.019070 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:32:20.019305 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.019160 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs podName:22f5a108-29e1-475b-a485-f5b42c371cb9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:20.519140163 +0000 UTC m=+36.076056050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs") pod "router-default-55c8f8654c-n89nb" (UID: "22f5a108-29e1-475b-a485-f5b42c371cb9") : secret "router-metrics-certs-default" not found Jul 24 14:32:20.019762 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.019737 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ba79270-3bec-4c43-97f2-3313aed19503-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:20.019863 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.019793 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1ba79270-3bec-4c43-97f2-3313aed19503-snapshots\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:20.019863 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.019809 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eeddf5b7-07cf-421b-a168-5b67bbb239f1-config\") pod \"console-operator-584dcb6b54-pn96s\" (UID: \"eeddf5b7-07cf-421b-a168-5b67bbb239f1\") " pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:32:20.019958 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.019883 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 14:32:20.019958 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.019944 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls podName:d002916e-5145-4d9a-b074-a5f1ef2a1194 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:20.519927013 +0000 UTC m=+36.076842898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m72p4" (UID: "d002916e-5145-4d9a-b074-a5f1ef2a1194") : secret "cluster-monitoring-operator-tls" not found Jul 24 14:32:20.020079 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.019954 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/34244aba-7d82-4b4e-aac5-216ee4e6bbaa-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w\" (UID: \"34244aba-7d82-4b4e-aac5-216ee4e6bbaa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w" Jul 24 14:32:20.020079 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.020062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldgxl\" (UniqueName: \"kubernetes.io/projected/4b150ceb-025b-45ad-9bca-e9a274b0c418-kube-api-access-ldgxl\") pod \"volume-data-source-validator-549c6d54cf-x2ndk\" (UID: \"4b150ceb-025b-45ad-9bca-e9a274b0c418\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x2ndk" Jul 24 14:32:20.021078 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.020091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:20.021078 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.020120 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eeddf5b7-07cf-421b-a168-5b67bbb239f1-trusted-ca\") pod \"console-operator-584dcb6b54-pn96s\" (UID: \"eeddf5b7-07cf-421b-a168-5b67bbb239f1\") " pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:32:20.021078 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.020206 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qfnzw\" (UID: \"fded2848-bd46-4040-94c3-ac7b1a47126b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" Jul 24 14:32:20.021078 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.020234 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ba79270-3bec-4c43-97f2-3313aed19503-service-ca-bundle\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:20.021078 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.020674 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 14:32:20.021078 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.020742 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls podName:fded2848-bd46-4040-94c3-ac7b1a47126b nodeName:}" failed. No retries permitted until 2026-07-24 14:32:20.520724613 +0000 UTC m=+36.077640483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls") pod "cluster-samples-operator-6748489656-qfnzw" (UID: "fded2848-bd46-4040-94c3-ac7b1a47126b") : secret "samples-operator-tls" not found Jul 24 14:32:20.021078 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.020859 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-stats-auth\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:20.021078 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.020993 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle podName:22f5a108-29e1-475b-a485-f5b42c371cb9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:20.5209759 +0000 UTC m=+36.077891790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle") pod "router-default-55c8f8654c-n89nb" (UID: "22f5a108-29e1-475b-a485-f5b42c371cb9") : configmap references non-existent config key: service-ca.crt Jul 24 14:32:20.021078 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.021048 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/34244aba-7d82-4b4e-aac5-216ee4e6bbaa-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w\" (UID: \"34244aba-7d82-4b4e-aac5-216ee4e6bbaa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w" Jul 24 14:32:20.021078 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.021078 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ba79270-3bec-4c43-97f2-3313aed19503-tmp\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:20.021630 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.021089 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eeddf5b7-07cf-421b-a168-5b67bbb239f1-trusted-ca\") pod \"console-operator-584dcb6b54-pn96s\" (UID: \"eeddf5b7-07cf-421b-a168-5b67bbb239f1\") " pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:32:20.021630 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.021103 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f122507-6dec-43f9-872f-fba90dbc59ea-config\") pod \"service-ca-operator-5d6c75f84f-x75xc\" (UID: \"0f122507-6dec-43f9-872f-fba90dbc59ea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc" Jul 24 14:32:20.021630 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.021144 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s4bq\" (UniqueName: \"kubernetes.io/projected/d002916e-5145-4d9a-b074-a5f1ef2a1194-kube-api-access-7s4bq\") pod \"cluster-monitoring-operator-548b489cb8-m72p4\" (UID: \"d002916e-5145-4d9a-b074-a5f1ef2a1194\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:20.021630 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.021623 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f122507-6dec-43f9-872f-fba90dbc59ea-config\") pod \"service-ca-operator-5d6c75f84f-x75xc\" (UID: \"0f122507-6dec-43f9-872f-fba90dbc59ea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc" Jul 24 14:32:20.021881 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.021864 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ba79270-3bec-4c43-97f2-3313aed19503-tmp\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:20.021936 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.021907 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eeddf5b7-07cf-421b-a168-5b67bbb239f1-serving-cert\") pod \"console-operator-584dcb6b54-pn96s\" (UID: \"eeddf5b7-07cf-421b-a168-5b67bbb239f1\") " pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:32:20.022280 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.022227 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1ba79270-3bec-4c43-97f2-3313aed19503-serving-cert\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:20.022800 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.022769 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-default-certificate\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:20.023276 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.023257 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b40cdad-7cb1-4132-9498-356e139cde9a-cert\") pod \"ingress-canary-zc6bp\" (UID: \"9b40cdad-7cb1-4132-9498-356e139cde9a\") " pod="openshift-ingress-canary/ingress-canary-zc6bp" Jul 24 14:32:20.023785 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.023765 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f122507-6dec-43f9-872f-fba90dbc59ea-serving-cert\") pod \"service-ca-operator-5d6c75f84f-x75xc\" (UID: \"0f122507-6dec-43f9-872f-fba90dbc59ea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc" Jul 24 14:32:20.023902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.023789 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/34244aba-7d82-4b4e-aac5-216ee4e6bbaa-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w\" (UID: \"34244aba-7d82-4b4e-aac5-216ee4e6bbaa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w" Jul 24 14:32:20.031578 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.031556 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f2j5\" (UniqueName: \"kubernetes.io/projected/0f122507-6dec-43f9-872f-fba90dbc59ea-kube-api-access-4f2j5\") pod \"service-ca-operator-5d6c75f84f-x75xc\" (UID: \"0f122507-6dec-43f9-872f-fba90dbc59ea\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc" Jul 24 14:32:20.040694 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.040663 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbj8p_e46c7c4a-495c-4166-b129-ddb313b4731b/konnectivity-agent/0.log" limit=1024 Jul 24 14:32:20.050566 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.049881 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfhs5\" (UniqueName: \"kubernetes.io/projected/9b40cdad-7cb1-4132-9498-356e139cde9a-kube-api-access-rfhs5\") pod \"ingress-canary-zc6bp\" (UID: \"9b40cdad-7cb1-4132-9498-356e139cde9a\") " pod="openshift-ingress-canary/ingress-canary-zc6bp" Jul 24 14:32:20.050566 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.050358 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75b55\" (UniqueName: \"kubernetes.io/projected/1ba79270-3bec-4c43-97f2-3313aed19503-kube-api-access-75b55\") pod \"insights-operator-5885fdb759-jx44r\" (UID: \"1ba79270-3bec-4c43-97f2-3313aed19503\") " pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:20.050566 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.050503 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8fbt\" (UniqueName: \"kubernetes.io/projected/eeddf5b7-07cf-421b-a168-5b67bbb239f1-kube-api-access-z8fbt\") pod \"console-operator-584dcb6b54-pn96s\" (UID: \"eeddf5b7-07cf-421b-a168-5b67bbb239f1\") " pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:32:20.050804 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.050776 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69cs8\" (UniqueName: \"kubernetes.io/projected/34244aba-7d82-4b4e-aac5-216ee4e6bbaa-kube-api-access-69cs8\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w\" (UID: \"34244aba-7d82-4b4e-aac5-216ee4e6bbaa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w" Jul 24 14:32:20.050858 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.050545 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2b7h\" (UniqueName: \"kubernetes.io/projected/8a792e60-4287-43e9-ba89-8f35e981b6fe-kube-api-access-d2b7h\") pod \"network-check-source-7d88cb55d8-6ps6n\" (UID: \"8a792e60-4287-43e9-ba89-8f35e981b6fe\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6ps6n" Jul 24 14:32:20.051038 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.051000 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldgxl\" (UniqueName: \"kubernetes.io/projected/4b150ceb-025b-45ad-9bca-e9a274b0c418-kube-api-access-ldgxl\") pod \"volume-data-source-validator-549c6d54cf-x2ndk\" (UID: \"4b150ceb-025b-45ad-9bca-e9a274b0c418\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x2ndk" Jul 24 14:32:20.051038 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.051012 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s4bq\" (UniqueName: \"kubernetes.io/projected/d002916e-5145-4d9a-b074-a5f1ef2a1194-kube-api-access-7s4bq\") pod \"cluster-monitoring-operator-548b489cb8-m72p4\" (UID: \"d002916e-5145-4d9a-b074-a5f1ef2a1194\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:20.051358 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.051325 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks79l\" (UniqueName: \"kubernetes.io/projected/fded2848-bd46-4040-94c3-ac7b1a47126b-kube-api-access-ks79l\") pod \"cluster-samples-operator-6748489656-qfnzw\" (UID: \"fded2848-bd46-4040-94c3-ac7b1a47126b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" Jul 24 14:32:20.051975 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.051952 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snvgk\" (UniqueName: \"kubernetes.io/projected/22f5a108-29e1-475b-a485-f5b42c371cb9-kube-api-access-snvgk\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:20.098156 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.098123 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w" Jul 24 14:32:20.105826 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.105799 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x2ndk" Jul 24 14:32:20.114935 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.114909 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-jx44r" Jul 24 14:32:20.122471 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.122448 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:20.122629 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.122486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxkq5\" (UniqueName: \"kubernetes.io/projected/e2238818-2359-4792-9170-4294d907f0dc-kube-api-access-kxkq5\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:20.122629 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.122583 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2238818-2359-4792-9170-4294d907f0dc-tmp-dir\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:20.122629 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.122616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2238818-2359-4792-9170-4294d907f0dc-config-volume\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:20.126553 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.124051 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2238818-2359-4792-9170-4294d907f0dc-tmp-dir\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:20.126553 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.124154 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:32:20.126553 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.124251 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls podName:e2238818-2359-4792-9170-4294d907f0dc nodeName:}" failed. No retries permitted until 2026-07-24 14:32:20.62422328 +0000 UTC m=+36.181139154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls") pod "dns-default-mc5kt" (UID: "e2238818-2359-4792-9170-4294d907f0dc") : secret "dns-default-metrics-tls" not found Jul 24 14:32:20.126553 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.124348 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2238818-2359-4792-9170-4294d907f0dc-config-volume\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:20.133611 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.133580 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc" Jul 24 14:32:20.134877 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.134838 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxkq5\" (UniqueName: \"kubernetes.io/projected/e2238818-2359-4792-9170-4294d907f0dc-kube-api-access-kxkq5\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:20.159371 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.159324 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:32:20.167170 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.166963 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6ps6n" Jul 24 14:32:20.168553 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.167663 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zc6bp" Jul 24 14:32:20.191358 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.190890 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-mx67k"] Jul 24 14:32:20.222363 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.219362 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mx67k" Jul 24 14:32:20.227899 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.226070 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sh44r\"" Jul 24 14:32:20.243303 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.243242 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbj8p_e46c7c4a-495c-4166-b129-ddb313b4731b/konnectivity-agent/0.log" limit=1024 Jul 24 14:32:20.328638 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.328394 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7843a4ee-c6d1-47b8-b660-84a7a2e49ca8-hosts-file\") pod \"node-resolver-mx67k\" (UID: \"7843a4ee-c6d1-47b8-b660-84a7a2e49ca8\") " pod="openshift-dns/node-resolver-mx67k" Jul 24 14:32:20.328638 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.328441 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7843a4ee-c6d1-47b8-b660-84a7a2e49ca8-tmp-dir\") pod \"node-resolver-mx67k\" (UID: \"7843a4ee-c6d1-47b8-b660-84a7a2e49ca8\") " pod="openshift-dns/node-resolver-mx67k" Jul 24 14:32:20.329063 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.328916 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlpcr\" (UniqueName: \"kubernetes.io/projected/7843a4ee-c6d1-47b8-b660-84a7a2e49ca8-kube-api-access-xlpcr\") pod \"node-resolver-mx67k\" (UID: \"7843a4ee-c6d1-47b8-b660-84a7a2e49ca8\") " pod="openshift-dns/node-resolver-mx67k" Jul 24 14:32:20.339641 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.338481 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbj8p_e46c7c4a-495c-4166-b129-ddb313b4731b/konnectivity-agent/0.log" limit=1024 Jul 24 14:32:20.367484 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.366603 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-jx44r"] Jul 24 14:32:20.369927 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:32:20.369884 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba79270_3bec_4c43_97f2_3313aed19503.slice/crio-632499a819161a0c89add7a7491018c53c456c24d9b507d032213a33c3204b11 WatchSource:0}: Error finding container 632499a819161a0c89add7a7491018c53c456c24d9b507d032213a33c3204b11: Status 404 returned error can't find the container with id 632499a819161a0c89add7a7491018c53c456c24d9b507d032213a33c3204b11 Jul 24 14:32:20.380457 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.380383 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w"] Jul 24 14:32:20.384969 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.381927 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x2ndk"] Jul 24 14:32:20.405426 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.405400 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc"] Jul 24 14:32:20.415561 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:32:20.415513 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f122507_6dec_43f9_872f_fba90dbc59ea.slice/crio-e689852b76f31d27f6b2b8739408c8c46718b0a66222696397a331ae646f7666 WatchSource:0}: Error finding container e689852b76f31d27f6b2b8739408c8c46718b0a66222696397a331ae646f7666: Status 404 returned error can't find the container with id e689852b76f31d27f6b2b8739408c8c46718b0a66222696397a331ae646f7666 Jul 24 14:32:20.429934 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.429908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlpcr\" (UniqueName: \"kubernetes.io/projected/7843a4ee-c6d1-47b8-b660-84a7a2e49ca8-kube-api-access-xlpcr\") pod \"node-resolver-mx67k\" (UID: \"7843a4ee-c6d1-47b8-b660-84a7a2e49ca8\") " pod="openshift-dns/node-resolver-mx67k" Jul 24 14:32:20.430077 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.429960 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:20.430077 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.430038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7843a4ee-c6d1-47b8-b660-84a7a2e49ca8-hosts-file\") pod \"node-resolver-mx67k\" (UID: \"7843a4ee-c6d1-47b8-b660-84a7a2e49ca8\") " pod="openshift-dns/node-resolver-mx67k" Jul 24 14:32:20.430077 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.430070 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7843a4ee-c6d1-47b8-b660-84a7a2e49ca8-tmp-dir\") pod \"node-resolver-mx67k\" (UID: \"7843a4ee-c6d1-47b8-b660-84a7a2e49ca8\") " pod="openshift-dns/node-resolver-mx67k" Jul 24 14:32:20.430241 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.430083 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 14:32:20.430241 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.430096 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bbb7bd6cb-99gms: secret "image-registry-tls" not found Jul 24 14:32:20.430241 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.430147 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls podName:c3d6f109-433f-4b97-b6f7-b42bb7cc79cf nodeName:}" failed. No retries permitted until 2026-07-24 14:32:21.430129395 +0000 UTC m=+36.987045284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls") pod "image-registry-6bbb7bd6cb-99gms" (UID: "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf") : secret "image-registry-tls" not found Jul 24 14:32:20.430379 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.430262 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7843a4ee-c6d1-47b8-b660-84a7a2e49ca8-hosts-file\") pod \"node-resolver-mx67k\" (UID: \"7843a4ee-c6d1-47b8-b660-84a7a2e49ca8\") " pod="openshift-dns/node-resolver-mx67k" Jul 24 14:32:20.430470 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.430448 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7843a4ee-c6d1-47b8-b660-84a7a2e49ca8-tmp-dir\") pod \"node-resolver-mx67k\" (UID: \"7843a4ee-c6d1-47b8-b660-84a7a2e49ca8\") " pod="openshift-dns/node-resolver-mx67k" Jul 24 14:32:20.435019 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.434990 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-pn96s"] Jul 24 14:32:20.439725 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:32:20.439671 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeddf5b7_07cf_421b_a168_5b67bbb239f1.slice/crio-d37dc447062a8a7c3ed4a7afc6ac365bdaf686005a567533e466ace681d9d2fc WatchSource:0}: Error finding container d37dc447062a8a7c3ed4a7afc6ac365bdaf686005a567533e466ace681d9d2fc: Status 404 returned error can't find the container with id d37dc447062a8a7c3ed4a7afc6ac365bdaf686005a567533e466ace681d9d2fc Jul 24 14:32:20.440686 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.440664 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlpcr\" (UniqueName: \"kubernetes.io/projected/7843a4ee-c6d1-47b8-b660-84a7a2e49ca8-kube-api-access-xlpcr\") pod \"node-resolver-mx67k\" (UID: \"7843a4ee-c6d1-47b8-b660-84a7a2e49ca8\") " pod="openshift-dns/node-resolver-mx67k" Jul 24 14:32:20.455100 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.455077 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zc6bp"] Jul 24 14:32:20.459585 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.459560 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-6ps6n"] Jul 24 14:32:20.460263 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:32:20.460234 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b40cdad_7cb1_4132_9498_356e139cde9a.slice/crio-f0c50c468a7c2f9bd7dfd3284d160265006d39229910df8d58801bba848edaea WatchSource:0}: Error finding container f0c50c468a7c2f9bd7dfd3284d160265006d39229910df8d58801bba848edaea: Status 404 returned error can't find the container with id f0c50c468a7c2f9bd7dfd3284d160265006d39229910df8d58801bba848edaea Jul 24 14:32:20.463452 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:32:20.463427 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a792e60_4287_43e9_ba89_8f35e981b6fe.slice/crio-8849637e818ab2ffc920f55e459c61063aa653985a4018dc867287a7b3c0520a WatchSource:0}: Error finding container 8849637e818ab2ffc920f55e459c61063aa653985a4018dc867287a7b3c0520a: Status 404 returned error can't find the container with id 8849637e818ab2ffc920f55e459c61063aa653985a4018dc867287a7b3c0520a Jul 24 14:32:20.531024 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.530989 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:20.531159 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.531062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m72p4\" (UID: \"d002916e-5145-4d9a-b074-a5f1ef2a1194\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:20.531159 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.531099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:20.531159 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.531117 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qfnzw\" (UID: \"fded2848-bd46-4040-94c3-ac7b1a47126b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" Jul 24 14:32:20.531357 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.531162 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:32:20.531357 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.531222 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 14:32:20.531357 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.531245 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 14:32:20.531357 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.531255 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs podName:22f5a108-29e1-475b-a485-f5b42c371cb9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:21.531228561 +0000 UTC m=+37.088144435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs") pod "router-default-55c8f8654c-n89nb" (UID: "22f5a108-29e1-475b-a485-f5b42c371cb9") : secret "router-metrics-certs-default" not found Jul 24 14:32:20.531357 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.531314 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle podName:22f5a108-29e1-475b-a485-f5b42c371cb9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:21.531296657 +0000 UTC m=+37.088212533 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle") pod "router-default-55c8f8654c-n89nb" (UID: "22f5a108-29e1-475b-a485-f5b42c371cb9") : configmap references non-existent config key: service-ca.crt Jul 24 14:32:20.531357 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.531331 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls podName:fded2848-bd46-4040-94c3-ac7b1a47126b nodeName:}" failed. No retries permitted until 2026-07-24 14:32:21.531321138 +0000 UTC m=+37.088237013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls") pod "cluster-samples-operator-6748489656-qfnzw" (UID: "fded2848-bd46-4040-94c3-ac7b1a47126b") : secret "samples-operator-tls" not found Jul 24 14:32:20.531357 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.531352 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls podName:d002916e-5145-4d9a-b074-a5f1ef2a1194 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:21.53134336 +0000 UTC m=+37.088259235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m72p4" (UID: "d002916e-5145-4d9a-b074-a5f1ef2a1194") : secret "cluster-monitoring-operator-tls" not found Jul 24 14:32:20.557751 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.557721 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mx67k" Jul 24 14:32:20.600205 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:32:20.600177 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7843a4ee_c6d1_47b8_b660_84a7a2e49ca8.slice/crio-0e09ab9d4c9e20bcb7e8b0943956beba91e2b548bee3178b8d5a94dfb11b58d9 WatchSource:0}: Error finding container 0e09ab9d4c9e20bcb7e8b0943956beba91e2b548bee3178b8d5a94dfb11b58d9: Status 404 returned error can't find the container with id 0e09ab9d4c9e20bcb7e8b0943956beba91e2b548bee3178b8d5a94dfb11b58d9 Jul 24 14:32:20.632233 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:20.632197 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:20.632381 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.632332 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:32:20.632441 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:20.632403 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls podName:e2238818-2359-4792-9170-4294d907f0dc nodeName:}" failed. No retries permitted until 2026-07-24 14:32:21.63238236 +0000 UTC m=+37.189298236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls") pod "dns-default-mc5kt" (UID: "e2238818-2359-4792-9170-4294d907f0dc") : secret "dns-default-metrics-tls" not found Jul 24 14:32:21.218312 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:21.218264 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mx67k" event={"ID":"7843a4ee-c6d1-47b8-b660-84a7a2e49ca8","Type":"ContainerStarted","Data":"e004ef45e542ca1a46248f4723f6b43b11238a9c3eb99979acc8a277b1072dc7"} Jul 24 14:32:21.219156 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:21.218331 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mx67k" event={"ID":"7843a4ee-c6d1-47b8-b660-84a7a2e49ca8","Type":"ContainerStarted","Data":"0e09ab9d4c9e20bcb7e8b0943956beba91e2b548bee3178b8d5a94dfb11b58d9"} Jul 24 14:32:21.219596 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:21.219568 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-jx44r" event={"ID":"1ba79270-3bec-4c43-97f2-3313aed19503","Type":"ContainerStarted","Data":"632499a819161a0c89add7a7491018c53c456c24d9b507d032213a33c3204b11"} Jul 24 14:32:21.220856 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:21.220824 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x2ndk" event={"ID":"4b150ceb-025b-45ad-9bca-e9a274b0c418","Type":"ContainerStarted","Data":"3f2e05662fd35e286e9a2a6b2059157825e95b53e2ef536d9a7817b9786a1ee7"} Jul 24 14:32:21.222105 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:21.222079 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w" event={"ID":"34244aba-7d82-4b4e-aac5-216ee4e6bbaa","Type":"ContainerStarted","Data":"6d91344a25e48a02bbc25711aba1354c1d7afc3a2c7e8f200725cd7074f3706f"} Jul 24 14:32:21.223243 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:21.223215 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc" event={"ID":"0f122507-6dec-43f9-872f-fba90dbc59ea","Type":"ContainerStarted","Data":"e689852b76f31d27f6b2b8739408c8c46718b0a66222696397a331ae646f7666"} Jul 24 14:32:21.224490 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:21.224468 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zc6bp" event={"ID":"9b40cdad-7cb1-4132-9498-356e139cde9a","Type":"ContainerStarted","Data":"f0c50c468a7c2f9bd7dfd3284d160265006d39229910df8d58801bba848edaea"} Jul 24 14:32:21.225676 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:21.225653 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6ps6n" event={"ID":"8a792e60-4287-43e9-ba89-8f35e981b6fe","Type":"ContainerStarted","Data":"8849637e818ab2ffc920f55e459c61063aa653985a4018dc867287a7b3c0520a"} Jul 24 14:32:21.226758 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:21.226736 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" event={"ID":"eeddf5b7-07cf-421b-a168-5b67bbb239f1","Type":"ContainerStarted","Data":"d37dc447062a8a7c3ed4a7afc6ac365bdaf686005a567533e466ace681d9d2fc"} Jul 24 14:32:21.233697 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:21.233653 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mx67k" podStartSLOduration=1.233639923 podStartE2EDuration="1.233639923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:32:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:21.233111495 +0000 UTC m=+36.790027386" watchObservedRunningTime="2026-07-24 14:32:21.233639923 +0000 UTC m=+36.790555815" Jul 24 14:32:21.440241 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:21.440196 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:21.440432 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:21.440371 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 14:32:21.440432 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:21.440393 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bbb7bd6cb-99gms: secret "image-registry-tls" not found Jul 24 14:32:21.440561 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:21.440460 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls podName:c3d6f109-433f-4b97-b6f7-b42bb7cc79cf nodeName:}" failed. No retries permitted until 2026-07-24 14:32:23.440440633 +0000 UTC m=+38.997356522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls") pod "image-registry-6bbb7bd6cb-99gms" (UID: "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf") : secret "image-registry-tls" not found Jul 24 14:32:21.541832 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:21.541788 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:21.542017 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:21.541893 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m72p4\" (UID: \"d002916e-5145-4d9a-b074-a5f1ef2a1194\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:21.542017 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:21.541939 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:21.542017 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:21.541962 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:32:21.542234 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:21.542033 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 14:32:21.542234 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:21.541966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qfnzw\" (UID: \"fded2848-bd46-4040-94c3-ac7b1a47126b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" Jul 24 14:32:21.542234 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:21.542050 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs podName:22f5a108-29e1-475b-a485-f5b42c371cb9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:23.542016511 +0000 UTC m=+39.098932380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs") pod "router-default-55c8f8654c-n89nb" (UID: "22f5a108-29e1-475b-a485-f5b42c371cb9") : secret "router-metrics-certs-default" not found Jul 24 14:32:21.542234 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:21.542039 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 14:32:21.542234 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:21.542084 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle podName:22f5a108-29e1-475b-a485-f5b42c371cb9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:23.542067261 +0000 UTC m=+39.098983131 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle") pod "router-default-55c8f8654c-n89nb" (UID: "22f5a108-29e1-475b-a485-f5b42c371cb9") : configmap references non-existent config key: service-ca.crt Jul 24 14:32:21.542234 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:21.542101 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls podName:d002916e-5145-4d9a-b074-a5f1ef2a1194 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:23.542094425 +0000 UTC m=+39.099010294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m72p4" (UID: "d002916e-5145-4d9a-b074-a5f1ef2a1194") : secret "cluster-monitoring-operator-tls" not found Jul 24 14:32:21.542234 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:21.542113 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls podName:fded2848-bd46-4040-94c3-ac7b1a47126b nodeName:}" failed. No retries permitted until 2026-07-24 14:32:23.542107439 +0000 UTC m=+39.099023309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls") pod "cluster-samples-operator-6748489656-qfnzw" (UID: "fded2848-bd46-4040-94c3-ac7b1a47126b") : secret "samples-operator-tls" not found Jul 24 14:32:21.642881 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:21.642834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:21.643051 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:21.643026 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:32:21.643109 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:21.643099 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls podName:e2238818-2359-4792-9170-4294d907f0dc nodeName:}" failed. No retries permitted until 2026-07-24 14:32:23.643083763 +0000 UTC m=+39.199999633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls") pod "dns-default-mc5kt" (UID: "e2238818-2359-4792-9170-4294d907f0dc") : secret "dns-default-metrics-tls" not found Jul 24 14:32:22.088165 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:22.087925 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p"] Jul 24 14:32:22.096869 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:22.096840 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" Jul 24 14:32:22.099833 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:22.099654 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 24 14:32:22.099833 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:22.099680 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wjp2v\"" Jul 24 14:32:22.099833 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:22.099664 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 24 14:32:22.100111 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:22.100093 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p"] Jul 24 14:32:22.212678 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:22.212641 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbj8p_e46c7c4a-495c-4166-b129-ddb313b4731b/konnectivity-agent/0.log" limit=1024 Jul 24 14:32:22.247642 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:22.247607 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hsh7p\" (UID: \"bea90f67-deec-4a7b-97ec-6491657a3019\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" Jul 24 14:32:22.248061 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:22.247697 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bea90f67-deec-4a7b-97ec-6491657a3019-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-hsh7p\" (UID: \"bea90f67-deec-4a7b-97ec-6491657a3019\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" Jul 24 14:32:22.292018 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:22.291976 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbj8p_e46c7c4a-495c-4166-b129-ddb313b4731b/konnectivity-agent/0.log" limit=1024 Jul 24 14:32:22.348260 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:22.348175 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hsh7p\" (UID: \"bea90f67-deec-4a7b-97ec-6491657a3019\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" Jul 24 14:32:22.348260 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:22.348246 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bea90f67-deec-4a7b-97ec-6491657a3019-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-hsh7p\" (UID: \"bea90f67-deec-4a7b-97ec-6491657a3019\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" Jul 24 14:32:22.348442 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:22.348335 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 14:32:22.348442 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:22.348403 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert podName:bea90f67-deec-4a7b-97ec-6491657a3019 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:22.848387725 +0000 UTC m=+38.405303595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-hsh7p" (UID: "bea90f67-deec-4a7b-97ec-6491657a3019") : secret "networking-console-plugin-cert" not found Jul 24 14:32:22.348819 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:22.348801 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bea90f67-deec-4a7b-97ec-6491657a3019-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-hsh7p\" (UID: \"bea90f67-deec-4a7b-97ec-6491657a3019\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" Jul 24 14:32:22.369253 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:22.369203 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbj8p_e46c7c4a-495c-4166-b129-ddb313b4731b/konnectivity-agent/0.log" limit=1024 Jul 24 14:32:22.434450 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:22.434412 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbj8p_e46c7c4a-495c-4166-b129-ddb313b4731b/konnectivity-agent/0.log" limit=1024 Jul 24 14:32:22.854269 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:22.853463 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hsh7p\" (UID: \"bea90f67-deec-4a7b-97ec-6491657a3019\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" Jul 24 14:32:22.854269 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:22.853805 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 14:32:22.854269 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:22.853874 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert podName:bea90f67-deec-4a7b-97ec-6491657a3019 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:23.853855198 +0000 UTC m=+39.410771072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-hsh7p" (UID: "bea90f67-deec-4a7b-97ec-6491657a3019") : secret "networking-console-plugin-cert" not found Jul 24 14:32:23.253249 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:23.252225 2581 generic.go:356] "Generic (PLEG): container finished" podID="f801522b-b504-4771-bfd2-0f4f0d52affd" containerID="0aaa08176139d90f136a2587645c0667ad1d8803890b05f04b7339e304efd21b" exitCode=0 Jul 24 14:32:23.253249 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:23.252316 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx2c" event={"ID":"f801522b-b504-4771-bfd2-0f4f0d52affd","Type":"ContainerDied","Data":"0aaa08176139d90f136a2587645c0667ad1d8803890b05f04b7339e304efd21b"} Jul 24 14:32:23.459602 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:23.459562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:23.459877 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:23.459861 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 14:32:23.459948 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:23.459882 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bbb7bd6cb-99gms: secret "image-registry-tls" not found Jul 24 14:32:23.459948 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:23.459943 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls podName:c3d6f109-433f-4b97-b6f7-b42bb7cc79cf nodeName:}" failed. No retries permitted until 2026-07-24 14:32:27.459923978 +0000 UTC m=+43.016839850 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls") pod "image-registry-6bbb7bd6cb-99gms" (UID: "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf") : secret "image-registry-tls" not found Jul 24 14:32:23.560231 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:23.560185 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m72p4\" (UID: \"d002916e-5145-4d9a-b074-a5f1ef2a1194\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:23.560424 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:23.560261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:23.560424 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:23.560310 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qfnzw\" (UID: \"fded2848-bd46-4040-94c3-ac7b1a47126b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" Jul 24 14:32:23.560424 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:23.560353 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 14:32:23.560424 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:23.560419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:23.560647 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:23.560437 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls podName:d002916e-5145-4d9a-b074-a5f1ef2a1194 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:27.560413408 +0000 UTC m=+43.117329283 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m72p4" (UID: "d002916e-5145-4d9a-b074-a5f1ef2a1194") : secret "cluster-monitoring-operator-tls" not found Jul 24 14:32:23.560647 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:23.560500 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:32:23.560647 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:23.560562 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs podName:22f5a108-29e1-475b-a485-f5b42c371cb9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:27.560547533 +0000 UTC m=+43.117463402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs") pod "router-default-55c8f8654c-n89nb" (UID: "22f5a108-29e1-475b-a485-f5b42c371cb9") : secret "router-metrics-certs-default" not found Jul 24 14:32:23.560647 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:23.560631 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle podName:22f5a108-29e1-475b-a485-f5b42c371cb9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:27.560621675 +0000 UTC m=+43.117537545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle") pod "router-default-55c8f8654c-n89nb" (UID: "22f5a108-29e1-475b-a485-f5b42c371cb9") : configmap references non-existent config key: service-ca.crt Jul 24 14:32:23.561318 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:23.560700 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 14:32:23.561318 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:23.560732 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls podName:fded2848-bd46-4040-94c3-ac7b1a47126b nodeName:}" failed. No retries permitted until 2026-07-24 14:32:27.560722415 +0000 UTC m=+43.117638286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls") pod "cluster-samples-operator-6748489656-qfnzw" (UID: "fded2848-bd46-4040-94c3-ac7b1a47126b") : secret "samples-operator-tls" not found Jul 24 14:32:23.661648 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:23.661607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:23.661830 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:23.661810 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:32:23.661889 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:23.661871 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls podName:e2238818-2359-4792-9170-4294d907f0dc nodeName:}" failed. No retries permitted until 2026-07-24 14:32:27.661852978 +0000 UTC m=+43.218768853 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls") pod "dns-default-mc5kt" (UID: "e2238818-2359-4792-9170-4294d907f0dc") : secret "dns-default-metrics-tls" not found Jul 24 14:32:23.863131 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:23.863034 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hsh7p\" (UID: \"bea90f67-deec-4a7b-97ec-6491657a3019\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" Jul 24 14:32:23.863399 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:23.863380 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 14:32:23.863475 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:23.863457 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert podName:bea90f67-deec-4a7b-97ec-6491657a3019 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:25.863437148 +0000 UTC m=+41.420353037 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-hsh7p" (UID: "bea90f67-deec-4a7b-97ec-6491657a3019") : secret "networking-console-plugin-cert" not found Jul 24 14:32:24.262999 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:24.262931 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx2c" event={"ID":"f801522b-b504-4771-bfd2-0f4f0d52affd","Type":"ContainerStarted","Data":"b09db6f1d21c20c2767c593616a9c0c6bb5f5c7e5b1dc7ef3a570c5c6a47043c"} Jul 24 14:32:24.408483 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:24.408408 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbj8p_e46c7c4a-495c-4166-b129-ddb313b4731b/konnectivity-agent/0.log" limit=1024 Jul 24 14:32:24.478177 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:24.478130 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbj8p_e46c7c4a-495c-4166-b129-ddb313b4731b/konnectivity-agent/0.log" limit=1024 Jul 24 14:32:24.637090 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:24.637044 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbj8p_e46c7c4a-495c-4166-b129-ddb313b4731b/konnectivity-agent/0.log" limit=1024 Jul 24 14:32:24.739272 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:24.739186 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbj8p_e46c7c4a-495c-4166-b129-ddb313b4731b/konnectivity-agent/0.log" limit=1024 Jul 24 14:32:24.840227 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:24.840178 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbj8p_e46c7c4a-495c-4166-b129-ddb313b4731b/konnectivity-agent/0.log" limit=1024 Jul 24 14:32:25.269624 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:25.269588 2581 generic.go:356] "Generic (PLEG): container finished" podID="f801522b-b504-4771-bfd2-0f4f0d52affd" containerID="b09db6f1d21c20c2767c593616a9c0c6bb5f5c7e5b1dc7ef3a570c5c6a47043c" exitCode=0 Jul 24 14:32:25.270065 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:25.269654 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx2c" event={"ID":"f801522b-b504-4771-bfd2-0f4f0d52affd","Type":"ContainerDied","Data":"b09db6f1d21c20c2767c593616a9c0c6bb5f5c7e5b1dc7ef3a570c5c6a47043c"} Jul 24 14:32:25.424429 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:25.424336 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbj8p_e46c7c4a-495c-4166-b129-ddb313b4731b/konnectivity-agent/0.log" limit=1024 Jul 24 14:32:25.500782 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:25.500739 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbj8p_e46c7c4a-495c-4166-b129-ddb313b4731b/konnectivity-agent/0.log" limit=1024 Jul 24 14:32:25.885319 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:25.885273 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hsh7p\" (UID: \"bea90f67-deec-4a7b-97ec-6491657a3019\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" Jul 24 14:32:25.885509 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:25.885426 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 14:32:25.885509 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:25.885493 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert podName:bea90f67-deec-4a7b-97ec-6491657a3019 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:29.885477047 +0000 UTC m=+45.442392918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-hsh7p" (UID: "bea90f67-deec-4a7b-97ec-6491657a3019") : secret "networking-console-plugin-cert" not found Jul 24 14:32:27.500742 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:27.500656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:27.501178 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:27.500841 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 14:32:27.501178 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:27.500865 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bbb7bd6cb-99gms: secret "image-registry-tls" not found Jul 24 14:32:27.501178 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:27.500940 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls podName:c3d6f109-433f-4b97-b6f7-b42bb7cc79cf nodeName:}" failed. No retries permitted until 2026-07-24 14:32:35.500919185 +0000 UTC m=+51.057835055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls") pod "image-registry-6bbb7bd6cb-99gms" (UID: "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf") : secret "image-registry-tls" not found Jul 24 14:32:27.601454 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:27.601411 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m72p4\" (UID: \"d002916e-5145-4d9a-b074-a5f1ef2a1194\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:27.601653 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:27.601475 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:27.601653 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:27.601503 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qfnzw\" (UID: \"fded2848-bd46-4040-94c3-ac7b1a47126b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" Jul 24 14:32:27.601653 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:27.601578 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 14:32:27.601653 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:27.601645 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls podName:d002916e-5145-4d9a-b074-a5f1ef2a1194 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:35.601629549 +0000 UTC m=+51.158545418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m72p4" (UID: "d002916e-5145-4d9a-b074-a5f1ef2a1194") : secret "cluster-monitoring-operator-tls" not found Jul 24 14:32:27.601846 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:27.601660 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle podName:22f5a108-29e1-475b-a485-f5b42c371cb9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:35.601654474 +0000 UTC m=+51.158570344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle") pod "router-default-55c8f8654c-n89nb" (UID: "22f5a108-29e1-475b-a485-f5b42c371cb9") : configmap references non-existent config key: service-ca.crt Jul 24 14:32:27.601846 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:27.601667 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 14:32:27.601846 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:27.601680 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:27.601846 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:27.601716 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls podName:fded2848-bd46-4040-94c3-ac7b1a47126b nodeName:}" failed. No retries permitted until 2026-07-24 14:32:35.601699486 +0000 UTC m=+51.158615362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls") pod "cluster-samples-operator-6748489656-qfnzw" (UID: "fded2848-bd46-4040-94c3-ac7b1a47126b") : secret "samples-operator-tls" not found Jul 24 14:32:27.601846 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:27.601750 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:32:27.601846 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:27.601787 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs podName:22f5a108-29e1-475b-a485-f5b42c371cb9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:35.60177658 +0000 UTC m=+51.158692451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs") pod "router-default-55c8f8654c-n89nb" (UID: "22f5a108-29e1-475b-a485-f5b42c371cb9") : secret "router-metrics-certs-default" not found Jul 24 14:32:27.702827 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:27.702790 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:27.703017 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:27.702954 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:32:27.703086 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:27.703022 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls podName:e2238818-2359-4792-9170-4294d907f0dc nodeName:}" failed. No retries permitted until 2026-07-24 14:32:35.703005555 +0000 UTC m=+51.259921425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls") pod "dns-default-mc5kt" (UID: "e2238818-2359-4792-9170-4294d907f0dc") : secret "dns-default-metrics-tls" not found Jul 24 14:32:29.921392 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:29.921362 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hsh7p\" (UID: \"bea90f67-deec-4a7b-97ec-6491657a3019\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" Jul 24 14:32:29.921713 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:29.921496 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 14:32:29.921713 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:29.921588 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert podName:bea90f67-deec-4a7b-97ec-6491657a3019 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:37.921567808 +0000 UTC m=+53.478483680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-hsh7p" (UID: "bea90f67-deec-4a7b-97ec-6491657a3019") : secret "networking-console-plugin-cert" not found Jul 24 14:32:30.290907 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.290795 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc" event={"ID":"0f122507-6dec-43f9-872f-fba90dbc59ea","Type":"ContainerStarted","Data":"4618609c2020c4b7b2df8489b8156bf495de813a7feac61b967ce166848bfe5d"} Jul 24 14:32:30.293165 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.292691 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zc6bp" event={"ID":"9b40cdad-7cb1-4132-9498-356e139cde9a","Type":"ContainerStarted","Data":"3f30ab368b34bc36b688c0d38c52d9547bf22034bc15cbbb97b815815a3ae14c"} Jul 24 14:32:30.294757 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.294733 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6ps6n" event={"ID":"8a792e60-4287-43e9-ba89-8f35e981b6fe","Type":"ContainerStarted","Data":"00c314217d7bdf5e01130a6699c24c5267c8fb126977843eb6f6b8a47f690810"} Jul 24 14:32:30.296652 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.296630 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/0.log" Jul 24 14:32:30.296769 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.296664 2581 generic.go:356] "Generic (PLEG): container finished" podID="eeddf5b7-07cf-421b-a168-5b67bbb239f1" containerID="2db03974a95ee11233e746af681aeafbe2858d2ce470450cda9ca251194aa196" exitCode=255 Jul 24 14:32:30.296878 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.296857 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" event={"ID":"eeddf5b7-07cf-421b-a168-5b67bbb239f1","Type":"ContainerDied","Data":"2db03974a95ee11233e746af681aeafbe2858d2ce470450cda9ca251194aa196"} Jul 24 14:32:30.296981 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.296926 2581 scope.go:117] "RemoveContainer" containerID="2db03974a95ee11233e746af681aeafbe2858d2ce470450cda9ca251194aa196" Jul 24 14:32:30.302224 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.302181 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gqx2c" event={"ID":"f801522b-b504-4771-bfd2-0f4f0d52affd","Type":"ContainerStarted","Data":"411ebfb70dbe5b88d216db772f64f61af525c07fa07b2bd50503e96d1a72f2b9"} Jul 24 14:32:30.305633 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.305139 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-jx44r" event={"ID":"1ba79270-3bec-4c43-97f2-3313aed19503","Type":"ContainerStarted","Data":"5af38858c6f032ced7a5b2c8ebac3dba4b159555d47259f66a0bbef22af56af0"} Jul 24 14:32:30.307494 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.307122 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x2ndk" event={"ID":"4b150ceb-025b-45ad-9bca-e9a274b0c418","Type":"ContainerStarted","Data":"a2f7c3905bb82cfef08260517b2d00b6cdd99628b2a17db9890e4e9cdb72bf9b"} Jul 24 14:32:30.309286 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.309202 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc" podStartSLOduration=6.771798507 podStartE2EDuration="16.309172641s" totalImagesPullingTime="9.537374134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:30.308467811 +0000 UTC m=+45.865383704" watchObservedRunningTime="2026-07-24 14:32:30.309172641 +0000 UTC m=+45.866088535" Jul 24 14:32:30.310701 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.310643 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w" event={"ID":"34244aba-7d82-4b4e-aac5-216ee4e6bbaa","Type":"ContainerStarted","Data":"856012d2ad8240bd9d03f77988fc9df253d8e014b492a867ef79b775c4befd63"} Jul 24 14:32:30.328783 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.327333 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6ps6n" podStartSLOduration=3.827192459 podStartE2EDuration="13.327314134s" totalImagesPullingTime="9.500121675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:30.326963512 +0000 UTC m=+45.883879405" watchObservedRunningTime="2026-07-24 14:32:30.327314134 +0000 UTC m=+45.884230028" Jul 24 14:32:30.381809 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.381744 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gqx2c" podStartSLOduration=13.890069488 podStartE2EDuration="45.381704674s" totalImagesPullingTime="31.491635186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:31:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:30.380214598 +0000 UTC m=+45.937130493" watchObservedRunningTime="2026-07-24 14:32:30.381704674 +0000 UTC m=+45.938620570" Jul 24 14:32:30.382872 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.382813 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-jx44r" podStartSLOduration=6.801056793 podStartE2EDuration="16.382798509s" totalImagesPullingTime="9.581741716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:30.354991488 +0000 UTC m=+45.911907383" watchObservedRunningTime="2026-07-24 14:32:30.382798509 +0000 UTC m=+45.939714401" Jul 24 14:32:30.401111 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.400804 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-x2ndk" podStartSLOduration=6.913504623 podStartE2EDuration="16.400785548s" totalImagesPullingTime="9.487280925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:30.399207287 +0000 UTC m=+45.956123183" watchObservedRunningTime="2026-07-24 14:32:30.400785548 +0000 UTC m=+45.957701422" Jul 24 14:32:30.472113 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.472063 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zc6bp" podStartSLOduration=1.9788483719999999 podStartE2EDuration="11.472047299s" totalImagesPullingTime="9.493198927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:30.470411142 +0000 UTC m=+46.027327051" watchObservedRunningTime="2026-07-24 14:32:30.472047299 +0000 UTC m=+46.028963191" Jul 24 14:32:30.494286 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.494228 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w" podStartSLOduration=6.930124259 podStartE2EDuration="16.494207169s" totalImagesPullingTime="9.56408291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:30.492735618 +0000 UTC m=+46.049651506" watchObservedRunningTime="2026-07-24 14:32:30.494207169 +0000 UTC m=+46.051123063" Jul 24 14:32:30.864686 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.864644 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qqwbj"] Jul 24 14:32:30.886808 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.886778 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qqwbj"] Jul 24 14:32:30.886977 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.886907 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:30.889816 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.889789 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m7vj4\"" Jul 24 14:32:30.890451 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.889798 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 14:32:30.890584 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:30.889842 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 14:32:31.036506 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.036451 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d12d587-003d-4a55-b730-17a03d9ab3f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:31.036506 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.036505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:31.037046 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.036582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d12d587-003d-4a55-b730-17a03d9ab3f9-crio-socket\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:31.037046 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.036661 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8knw\" (UniqueName: \"kubernetes.io/projected/2d12d587-003d-4a55-b730-17a03d9ab3f9-kube-api-access-f8knw\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:31.037046 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.036752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d12d587-003d-4a55-b730-17a03d9ab3f9-data-volume\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:31.137499 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.137409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d12d587-003d-4a55-b730-17a03d9ab3f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:31.137499 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.137464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:31.137743 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.137509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d12d587-003d-4a55-b730-17a03d9ab3f9-crio-socket\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:31.137743 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:31.137560 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:32:31.137743 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.137582 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8knw\" (UniqueName: \"kubernetes.io/projected/2d12d587-003d-4a55-b730-17a03d9ab3f9-kube-api-access-f8knw\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:31.137743 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:31.137640 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d12d587-003d-4a55-b730-17a03d9ab3f9-kube-rbac-proxy-cm podName:2d12d587-003d-4a55-b730-17a03d9ab3f9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:31.637617244 +0000 UTC m=+47.194533115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d12d587-003d-4a55-b730-17a03d9ab3f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qqwbj" (UID: "2d12d587-003d-4a55-b730-17a03d9ab3f9") : configmap "kube-rbac-proxy" not found Jul 24 14:32:31.137743 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:31.137666 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:32:31.137743 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.137700 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d12d587-003d-4a55-b730-17a03d9ab3f9-crio-socket\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:31.137743 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.137721 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d12d587-003d-4a55-b730-17a03d9ab3f9-data-volume\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:31.137743 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:31.137732 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls podName:2d12d587-003d-4a55-b730-17a03d9ab3f9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:31.637713305 +0000 UTC m=+47.194629181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qqwbj" (UID: "2d12d587-003d-4a55-b730-17a03d9ab3f9") : secret "insights-runtime-extractor-tls" not found Jul 24 14:32:31.138147 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.138126 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d12d587-003d-4a55-b730-17a03d9ab3f9-data-volume\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:31.147834 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.147800 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8knw\" (UniqueName: \"kubernetes.io/projected/2d12d587-003d-4a55-b730-17a03d9ab3f9-kube-api-access-f8knw\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:31.316746 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.316716 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 14:32:31.317185 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.317171 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/0.log" Jul 24 14:32:31.317256 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.317205 2581 generic.go:356] "Generic (PLEG): container finished" podID="eeddf5b7-07cf-421b-a168-5b67bbb239f1" containerID="1c85ea7595e37616eef34e8d90676e29ef44f12979127082d623831918fa7d92" exitCode=255 Jul 24 14:32:31.317310 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.317281 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" event={"ID":"eeddf5b7-07cf-421b-a168-5b67bbb239f1","Type":"ContainerDied","Data":"1c85ea7595e37616eef34e8d90676e29ef44f12979127082d623831918fa7d92"} Jul 24 14:32:31.317363 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.317327 2581 scope.go:117] "RemoveContainer" containerID="2db03974a95ee11233e746af681aeafbe2858d2ce470450cda9ca251194aa196" Jul 24 14:32:31.317989 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.317573 2581 scope.go:117] "RemoveContainer" containerID="1c85ea7595e37616eef34e8d90676e29ef44f12979127082d623831918fa7d92" Jul 24 14:32:31.317989 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:31.317782 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-pn96s_openshift-console-operator(eeddf5b7-07cf-421b-a168-5b67bbb239f1)\"" pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" podUID="eeddf5b7-07cf-421b-a168-5b67bbb239f1" Jul 24 14:32:31.644333 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.644297 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d12d587-003d-4a55-b730-17a03d9ab3f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:31.644506 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.644344 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:31.644506 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:31.644423 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:32:31.644506 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:31.644499 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d12d587-003d-4a55-b730-17a03d9ab3f9-kube-rbac-proxy-cm podName:2d12d587-003d-4a55-b730-17a03d9ab3f9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:32.644479029 +0000 UTC m=+48.201394921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d12d587-003d-4a55-b730-17a03d9ab3f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qqwbj" (UID: "2d12d587-003d-4a55-b730-17a03d9ab3f9") : configmap "kube-rbac-proxy" not found Jul 24 14:32:31.644680 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:31.644547 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:32:31.644680 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:31.644629 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls podName:2d12d587-003d-4a55-b730-17a03d9ab3f9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:32.644611703 +0000 UTC m=+48.201527592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qqwbj" (UID: "2d12d587-003d-4a55-b730-17a03d9ab3f9") : secret "insights-runtime-extractor-tls" not found Jul 24 14:32:31.929781 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.929700 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-dmpsc"] Jul 24 14:32:31.957266 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.957212 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-dmpsc"] Jul 24 14:32:31.957456 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.957359 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dmpsc" Jul 24 14:32:31.959936 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.959894 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bh4cz\"" Jul 24 14:32:31.960816 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.960799 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 24 14:32:31.960916 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:31.960854 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 24 14:32:32.148334 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:32.148299 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwv89\" (UniqueName: \"kubernetes.io/projected/d749a88e-2437-4fbf-8ba7-80ef1759d043-kube-api-access-zwv89\") pod \"migrator-6865c9967-dmpsc\" (UID: \"d749a88e-2437-4fbf-8ba7-80ef1759d043\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dmpsc" Jul 24 14:32:32.155856 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:32.155837 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mx67k_7843a4ee-c6d1-47b8-b660-84a7a2e49ca8/dns-node-resolver/0.log" Jul 24 14:32:32.249521 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:32.249439 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwv89\" (UniqueName: \"kubernetes.io/projected/d749a88e-2437-4fbf-8ba7-80ef1759d043-kube-api-access-zwv89\") pod \"migrator-6865c9967-dmpsc\" (UID: \"d749a88e-2437-4fbf-8ba7-80ef1759d043\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dmpsc" Jul 24 14:32:32.257546 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:32.257508 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwv89\" (UniqueName: \"kubernetes.io/projected/d749a88e-2437-4fbf-8ba7-80ef1759d043-kube-api-access-zwv89\") pod \"migrator-6865c9967-dmpsc\" (UID: \"d749a88e-2437-4fbf-8ba7-80ef1759d043\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dmpsc" Jul 24 14:32:32.267383 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:32.267364 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dmpsc" Jul 24 14:32:32.322425 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:32.322396 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 14:32:32.322838 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:32.322814 2581 scope.go:117] "RemoveContainer" containerID="1c85ea7595e37616eef34e8d90676e29ef44f12979127082d623831918fa7d92" Jul 24 14:32:32.322999 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:32.322976 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-pn96s_openshift-console-operator(eeddf5b7-07cf-421b-a168-5b67bbb239f1)\"" pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" podUID="eeddf5b7-07cf-421b-a168-5b67bbb239f1" Jul 24 14:32:32.416068 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:32.416039 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-dmpsc"] Jul 24 14:32:32.419128 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:32:32.419104 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd749a88e_2437_4fbf_8ba7_80ef1759d043.slice/crio-96567b76226db43f2c917e063842df4003c2cec27b7823966303d4955eefc168 WatchSource:0}: Error finding container 96567b76226db43f2c917e063842df4003c2cec27b7823966303d4955eefc168: Status 404 returned error can't find the container with id 96567b76226db43f2c917e063842df4003c2cec27b7823966303d4955eefc168 Jul 24 14:32:32.653516 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:32.653476 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d12d587-003d-4a55-b730-17a03d9ab3f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:32.653738 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:32.653568 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:32.653738 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:32.653593 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:32:32.653738 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:32.653651 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d12d587-003d-4a55-b730-17a03d9ab3f9-kube-rbac-proxy-cm podName:2d12d587-003d-4a55-b730-17a03d9ab3f9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:34.65363501 +0000 UTC m=+50.210550881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d12d587-003d-4a55-b730-17a03d9ab3f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qqwbj" (UID: "2d12d587-003d-4a55-b730-17a03d9ab3f9") : configmap "kube-rbac-proxy" not found Jul 24 14:32:32.653738 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:32.653731 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:32:32.653921 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:32.653811 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls podName:2d12d587-003d-4a55-b730-17a03d9ab3f9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:34.653791474 +0000 UTC m=+50.210707349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qqwbj" (UID: "2d12d587-003d-4a55-b730-17a03d9ab3f9") : secret "insights-runtime-extractor-tls" not found Jul 24 14:32:33.333961 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:33.333916 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dmpsc" event={"ID":"d749a88e-2437-4fbf-8ba7-80ef1759d043","Type":"ContainerStarted","Data":"96567b76226db43f2c917e063842df4003c2cec27b7823966303d4955eefc168"} Jul 24 14:32:33.355521 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:33.355493 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wsdqx_7703c0af-9df4-4f61-980a-558ccfe28fee/node-ca/0.log" Jul 24 14:32:33.755639 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:33.755553 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zc6bp_9b40cdad-7cb1-4132-9498-356e139cde9a/serve-healthcheck-canary/0.log" Jul 24 14:32:34.339278 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.339232 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dmpsc" event={"ID":"d749a88e-2437-4fbf-8ba7-80ef1759d043","Type":"ContainerStarted","Data":"dc1fca2a911393d20111387e4a8457cceaa0c7fcf6b18f4f747c465915d59aa6"} Jul 24 14:32:34.662763 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.662727 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-qd8v5"] Jul 24 14:32:34.672946 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.672914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d12d587-003d-4a55-b730-17a03d9ab3f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:34.672946 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.672947 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:34.673144 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:34.673057 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:32:34.673144 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:34.673109 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls podName:2d12d587-003d-4a55-b730-17a03d9ab3f9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:38.673095386 +0000 UTC m=+54.230011256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qqwbj" (UID: "2d12d587-003d-4a55-b730-17a03d9ab3f9") : secret "insights-runtime-extractor-tls" not found Jul 24 14:32:34.673566 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.673515 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d12d587-003d-4a55-b730-17a03d9ab3f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:34.687269 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.687230 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-qd8v5"] Jul 24 14:32:34.687386 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.687320 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-qd8v5" Jul 24 14:32:34.690609 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.690583 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 24 14:32:34.690711 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.690678 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-f9bcg\"" Jul 24 14:32:34.691549 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.691517 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 24 14:32:34.691634 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.691583 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 24 14:32:34.691634 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.691626 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 24 14:32:34.773590 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.773551 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8f583ebe-63b3-4c69-b30d-20cd5ab412ca-signing-cabundle\") pod \"service-ca-658d7b7c78-qd8v5\" (UID: \"8f583ebe-63b3-4c69-b30d-20cd5ab412ca\") " pod="openshift-service-ca/service-ca-658d7b7c78-qd8v5" Jul 24 14:32:34.773773 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.773611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8f583ebe-63b3-4c69-b30d-20cd5ab412ca-signing-key\") pod \"service-ca-658d7b7c78-qd8v5\" (UID: \"8f583ebe-63b3-4c69-b30d-20cd5ab412ca\") " pod="openshift-service-ca/service-ca-658d7b7c78-qd8v5" Jul 24 14:32:34.773773 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.773634 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbw6h\" (UniqueName: \"kubernetes.io/projected/8f583ebe-63b3-4c69-b30d-20cd5ab412ca-kube-api-access-nbw6h\") pod \"service-ca-658d7b7c78-qd8v5\" (UID: \"8f583ebe-63b3-4c69-b30d-20cd5ab412ca\") " pod="openshift-service-ca/service-ca-658d7b7c78-qd8v5" Jul 24 14:32:34.874682 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.874631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8f583ebe-63b3-4c69-b30d-20cd5ab412ca-signing-cabundle\") pod \"service-ca-658d7b7c78-qd8v5\" (UID: \"8f583ebe-63b3-4c69-b30d-20cd5ab412ca\") " pod="openshift-service-ca/service-ca-658d7b7c78-qd8v5" Jul 24 14:32:34.874854 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.874717 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8f583ebe-63b3-4c69-b30d-20cd5ab412ca-signing-key\") pod \"service-ca-658d7b7c78-qd8v5\" (UID: \"8f583ebe-63b3-4c69-b30d-20cd5ab412ca\") " pod="openshift-service-ca/service-ca-658d7b7c78-qd8v5" Jul 24 14:32:34.874854 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.874742 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbw6h\" (UniqueName: \"kubernetes.io/projected/8f583ebe-63b3-4c69-b30d-20cd5ab412ca-kube-api-access-nbw6h\") pod \"service-ca-658d7b7c78-qd8v5\" (UID: \"8f583ebe-63b3-4c69-b30d-20cd5ab412ca\") " pod="openshift-service-ca/service-ca-658d7b7c78-qd8v5" Jul 24 14:32:34.875288 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.875269 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8f583ebe-63b3-4c69-b30d-20cd5ab412ca-signing-cabundle\") pod \"service-ca-658d7b7c78-qd8v5\" (UID: \"8f583ebe-63b3-4c69-b30d-20cd5ab412ca\") " pod="openshift-service-ca/service-ca-658d7b7c78-qd8v5" Jul 24 14:32:34.877079 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.877060 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8f583ebe-63b3-4c69-b30d-20cd5ab412ca-signing-key\") pod \"service-ca-658d7b7c78-qd8v5\" (UID: \"8f583ebe-63b3-4c69-b30d-20cd5ab412ca\") " pod="openshift-service-ca/service-ca-658d7b7c78-qd8v5" Jul 24 14:32:34.894226 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.894195 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbw6h\" (UniqueName: \"kubernetes.io/projected/8f583ebe-63b3-4c69-b30d-20cd5ab412ca-kube-api-access-nbw6h\") pod \"service-ca-658d7b7c78-qd8v5\" (UID: \"8f583ebe-63b3-4c69-b30d-20cd5ab412ca\") " pod="openshift-service-ca/service-ca-658d7b7c78-qd8v5" Jul 24 14:32:34.995697 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:34.995624 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-qd8v5" Jul 24 14:32:35.141652 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:35.141620 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-qd8v5"] Jul 24 14:32:35.144245 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:32:35.144224 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f583ebe_63b3_4c69_b30d_20cd5ab412ca.slice/crio-77dc58e955514c9beb9caa1fca02229e5dd1cbfa4a225853bde731b4370a8f86 WatchSource:0}: Error finding container 77dc58e955514c9beb9caa1fca02229e5dd1cbfa4a225853bde731b4370a8f86: Status 404 returned error can't find the container with id 77dc58e955514c9beb9caa1fca02229e5dd1cbfa4a225853bde731b4370a8f86 Jul 24 14:32:35.343954 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:35.343918 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-qd8v5" event={"ID":"8f583ebe-63b3-4c69-b30d-20cd5ab412ca","Type":"ContainerStarted","Data":"c1540540e37aca8aeaa7ddcc11d80faa909fe46e042134da0952e7fdc02fa8d1"} Jul 24 14:32:35.344415 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:35.343975 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-qd8v5" event={"ID":"8f583ebe-63b3-4c69-b30d-20cd5ab412ca","Type":"ContainerStarted","Data":"77dc58e955514c9beb9caa1fca02229e5dd1cbfa4a225853bde731b4370a8f86"} Jul 24 14:32:35.345824 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:35.345795 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dmpsc" event={"ID":"d749a88e-2437-4fbf-8ba7-80ef1759d043","Type":"ContainerStarted","Data":"58cb51a1115152efa0786dda80ebb43f564e82f590c8ce46ea3e7091c44be425"} Jul 24 14:32:35.365509 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:35.365467 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-qd8v5" podStartSLOduration=1.365452961 podStartE2EDuration="1.365452961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:35.364205037 +0000 UTC m=+50.921120941" watchObservedRunningTime="2026-07-24 14:32:35.365452961 +0000 UTC m=+50.922368856" Jul 24 14:32:35.391772 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:35.391723 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dmpsc" podStartSLOduration=2.629841684 podStartE2EDuration="4.391709795s" totalImagesPullingTime="1.761868111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:35.390897313 +0000 UTC m=+50.947813205" watchObservedRunningTime="2026-07-24 14:32:35.391709795 +0000 UTC m=+50.948625687" Jul 24 14:32:35.580974 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:35.580930 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:35.581136 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:35.581085 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 14:32:35.581136 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:35.581104 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bbb7bd6cb-99gms: secret "image-registry-tls" not found Jul 24 14:32:35.581235 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:35.581156 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls podName:c3d6f109-433f-4b97-b6f7-b42bb7cc79cf nodeName:}" failed. No retries permitted until 2026-07-24 14:32:51.581142055 +0000 UTC m=+67.138057928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls") pod "image-registry-6bbb7bd6cb-99gms" (UID: "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf") : secret "image-registry-tls" not found Jul 24 14:32:35.682220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:35.682181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:35.682412 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:35.682252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m72p4\" (UID: \"d002916e-5145-4d9a-b074-a5f1ef2a1194\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:35.682412 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:35.682287 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:35.682412 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:35.682303 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qfnzw\" (UID: \"fded2848-bd46-4040-94c3-ac7b1a47126b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" Jul 24 14:32:35.682412 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:35.682358 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:32:35.682599 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:35.682359 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 14:32:35.682599 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:35.682446 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 14:32:35.682599 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:35.682426 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs podName:22f5a108-29e1-475b-a485-f5b42c371cb9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:51.682406494 +0000 UTC m=+67.239322367 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs") pod "router-default-55c8f8654c-n89nb" (UID: "22f5a108-29e1-475b-a485-f5b42c371cb9") : secret "router-metrics-certs-default" not found Jul 24 14:32:35.682599 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:35.682486 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle podName:22f5a108-29e1-475b-a485-f5b42c371cb9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:51.682468759 +0000 UTC m=+67.239384642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle") pod "router-default-55c8f8654c-n89nb" (UID: "22f5a108-29e1-475b-a485-f5b42c371cb9") : configmap references non-existent config key: service-ca.crt Jul 24 14:32:35.682599 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:35.682517 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls podName:d002916e-5145-4d9a-b074-a5f1ef2a1194 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:51.682507976 +0000 UTC m=+67.239423847 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m72p4" (UID: "d002916e-5145-4d9a-b074-a5f1ef2a1194") : secret "cluster-monitoring-operator-tls" not found Jul 24 14:32:35.682599 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:35.682572 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls podName:fded2848-bd46-4040-94c3-ac7b1a47126b nodeName:}" failed. No retries permitted until 2026-07-24 14:32:51.682560852 +0000 UTC m=+67.239476729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls") pod "cluster-samples-operator-6748489656-qfnzw" (UID: "fded2848-bd46-4040-94c3-ac7b1a47126b") : secret "samples-operator-tls" not found Jul 24 14:32:35.783361 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:35.783325 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:35.783552 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:35.783464 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:32:35.783620 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:35.783524 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls podName:e2238818-2359-4792-9170-4294d907f0dc nodeName:}" failed. No retries permitted until 2026-07-24 14:32:51.783507364 +0000 UTC m=+67.340423451 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls") pod "dns-default-mc5kt" (UID: "e2238818-2359-4792-9170-4294d907f0dc") : secret "dns-default-metrics-tls" not found Jul 24 14:32:38.004083 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:38.004043 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hsh7p\" (UID: \"bea90f67-deec-4a7b-97ec-6491657a3019\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" Jul 24 14:32:38.004546 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:38.004201 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 14:32:38.004546 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:38.004284 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert podName:bea90f67-deec-4a7b-97ec-6491657a3019 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:54.004259878 +0000 UTC m=+69.561175754 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-hsh7p" (UID: "bea90f67-deec-4a7b-97ec-6491657a3019") : secret "networking-console-plugin-cert" not found Jul 24 14:32:38.709337 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:38.709301 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:38.709490 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:38.709470 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:32:38.709580 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:38.709569 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls podName:2d12d587-003d-4a55-b730-17a03d9ab3f9 nodeName:}" failed. No retries permitted until 2026-07-24 14:32:46.709546835 +0000 UTC m=+62.266462720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qqwbj" (UID: "2d12d587-003d-4a55-b730-17a03d9ab3f9") : secret "insights-runtime-extractor-tls" not found Jul 24 14:32:40.159467 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:40.159426 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:32:40.159943 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:40.159485 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:32:40.159943 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:40.159839 2581 scope.go:117] "RemoveContainer" containerID="1c85ea7595e37616eef34e8d90676e29ef44f12979127082d623831918fa7d92" Jul 24 14:32:40.160021 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:32:40.159982 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-pn96s_openshift-console-operator(eeddf5b7-07cf-421b-a168-5b67bbb239f1)\"" pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" podUID="eeddf5b7-07cf-421b-a168-5b67bbb239f1" Jul 24 14:32:45.205658 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:45.205629 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5294p" Jul 24 14:32:46.784714 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:46.784679 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:46.787010 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:46.786973 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d12d587-003d-4a55-b730-17a03d9ab3f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qqwbj\" (UID: \"2d12d587-003d-4a55-b730-17a03d9ab3f9\") " pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:46.800862 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:46.800837 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m7vj4\"" Jul 24 14:32:46.808801 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:46.808786 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qqwbj" Jul 24 14:32:46.932443 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:46.932413 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qqwbj"] Jul 24 14:32:46.935144 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:32:46.935116 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d12d587_003d_4a55_b730_17a03d9ab3f9.slice/crio-cbfb088f267582a8a1e7612fd491ab1256f77445e590f9b9ba160b21b19dcbe2 WatchSource:0}: Error finding container cbfb088f267582a8a1e7612fd491ab1256f77445e590f9b9ba160b21b19dcbe2: Status 404 returned error can't find the container with id cbfb088f267582a8a1e7612fd491ab1256f77445e590f9b9ba160b21b19dcbe2 Jul 24 14:32:47.392148 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:47.392062 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qqwbj" event={"ID":"2d12d587-003d-4a55-b730-17a03d9ab3f9","Type":"ContainerStarted","Data":"cbfb088f267582a8a1e7612fd491ab1256f77445e590f9b9ba160b21b19dcbe2"} Jul 24 14:32:49.613027 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:49.612986 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs\") pod \"network-metrics-daemon-7s68w\" (UID: \"22897615-e1fd-4eb7-9694-81b23695e7a5\") " pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:32:49.613438 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:49.613142 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret\") pod \"global-pull-secret-syncer-2p6b9\" (UID: \"7ca81320-80de-485a-8225-cc323e3cefc8\") " pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:32:49.615865 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:49.615841 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 14:32:49.616438 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:49.616412 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 14:32:49.625735 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:49.625709 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca81320-80de-485a-8225-cc323e3cefc8-original-pull-secret\") pod \"global-pull-secret-syncer-2p6b9\" (UID: \"7ca81320-80de-485a-8225-cc323e3cefc8\") " pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:32:49.625834 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:49.625756 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22897615-e1fd-4eb7-9694-81b23695e7a5-metrics-certs\") pod \"network-metrics-daemon-7s68w\" (UID: \"22897615-e1fd-4eb7-9694-81b23695e7a5\") " pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:32:49.679914 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:49.679880 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tpbrb\"" Jul 24 14:32:49.688155 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:49.688131 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s68w" Jul 24 14:32:49.690393 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:49.690370 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2p6b9" Jul 24 14:32:49.814928 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:49.814889 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwjqh\" (UniqueName: \"kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh\") pod \"network-check-target-k7w5x\" (UID: \"33267e5b-9b26-472f-8b36-6fc795d5131d\") " pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:49.817792 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:49.817760 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwjqh\" (UniqueName: \"kubernetes.io/projected/33267e5b-9b26-472f-8b36-6fc795d5131d-kube-api-access-xwjqh\") pod \"network-check-target-k7w5x\" (UID: \"33267e5b-9b26-472f-8b36-6fc795d5131d\") " pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:49.987850 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:49.987781 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljg7j\"" Jul 24 14:32:49.994985 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:49.994953 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:51.631712 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.631671 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:51.633942 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.633916 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls\") pod \"image-registry-6bbb7bd6cb-99gms\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:51.732499 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.732472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:51.732633 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.732587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m72p4\" (UID: \"d002916e-5145-4d9a-b074-a5f1ef2a1194\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:51.732762 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.732666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:51.733744 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.732948 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qfnzw\" (UID: \"fded2848-bd46-4040-94c3-ac7b1a47126b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" Jul 24 14:32:51.733744 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.733632 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f5a108-29e1-475b-a485-f5b42c371cb9-service-ca-bundle\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:51.736468 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.736120 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d002916e-5145-4d9a-b074-a5f1ef2a1194-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m72p4\" (UID: \"d002916e-5145-4d9a-b074-a5f1ef2a1194\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:51.737096 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.737021 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f5a108-29e1-475b-a485-f5b42c371cb9-metrics-certs\") pod \"router-default-55c8f8654c-n89nb\" (UID: \"22f5a108-29e1-475b-a485-f5b42c371cb9\") " pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:51.737189 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.737129 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fded2848-bd46-4040-94c3-ac7b1a47126b-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qfnzw\" (UID: \"fded2848-bd46-4040-94c3-ac7b1a47126b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" Jul 24 14:32:51.766479 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.766436 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2p6b9"] Jul 24 14:32:51.771996 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:32:51.771961 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca81320_80de_485a_8225_cc323e3cefc8.slice/crio-a88c5781ccd1cb1d4076b275bf64d37896e87d3875d758f81f1cef447f9e0f75 WatchSource:0}: Error finding container a88c5781ccd1cb1d4076b275bf64d37896e87d3875d758f81f1cef447f9e0f75: Status 404 returned error can't find the container with id a88c5781ccd1cb1d4076b275bf64d37896e87d3875d758f81f1cef447f9e0f75 Jul 24 14:32:51.833570 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.833517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:51.835721 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.835699 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2238818-2359-4792-9170-4294d907f0dc-metrics-tls\") pod \"dns-default-mc5kt\" (UID: \"e2238818-2359-4792-9170-4294d907f0dc\") " pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:51.873197 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.873166 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2hm46\"" Jul 24 14:32:51.881331 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.881266 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:51.892391 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.892369 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-r24f9\"" Jul 24 14:32:51.901330 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.901309 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" Jul 24 14:32:51.929436 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.929409 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-d7dwf\"" Jul 24 14:32:51.937563 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.937426 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:51.954458 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.954411 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nlj9q\"" Jul 24 14:32:51.962731 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.962701 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" Jul 24 14:32:51.994799 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.994491 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m2jtv\"" Jul 24 14:32:51.995333 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:51.995246 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7s68w"] Jul 24 14:32:52.002895 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.001202 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mc5kt" Jul 24 14:32:52.002895 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:32:52.002290 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22897615_e1fd_4eb7_9694_81b23695e7a5.slice/crio-3ac0eaa15f67ceec06f070e0478d5a4d536e90d57a4dde364cb7a526cca7d59f WatchSource:0}: Error finding container 3ac0eaa15f67ceec06f070e0478d5a4d536e90d57a4dde364cb7a526cca7d59f: Status 404 returned error can't find the container with id 3ac0eaa15f67ceec06f070e0478d5a4d536e90d57a4dde364cb7a526cca7d59f Jul 24 14:32:52.004238 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.004165 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k7w5x"] Jul 24 14:32:52.005969 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:32:52.005553 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33267e5b_9b26_472f_8b36_6fc795d5131d.slice/crio-d18332aec33b590c3fdcacf175a588b9d52a5ba84418009b2357115d86f6688f WatchSource:0}: Error finding container d18332aec33b590c3fdcacf175a588b9d52a5ba84418009b2357115d86f6688f: Status 404 returned error can't find the container with id d18332aec33b590c3fdcacf175a588b9d52a5ba84418009b2357115d86f6688f Jul 24 14:32:52.041785 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.041302 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bbb7bd6cb-99gms"] Jul 24 14:32:52.088009 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.087909 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw"] Jul 24 14:32:52.157180 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.157153 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55c8f8654c-n89nb"] Jul 24 14:32:52.163651 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:32:52.163623 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f5a108_29e1_475b_a485_f5b42c371cb9.slice/crio-0b7c0f4f166e1846a19c7df6d3d7bba6bee0e5c66d15a1c74cc6111fe2b60fef WatchSource:0}: Error finding container 0b7c0f4f166e1846a19c7df6d3d7bba6bee0e5c66d15a1c74cc6111fe2b60fef: Status 404 returned error can't find the container with id 0b7c0f4f166e1846a19c7df6d3d7bba6bee0e5c66d15a1c74cc6111fe2b60fef Jul 24 14:32:52.169561 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.169469 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4"] Jul 24 14:32:52.173465 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:32:52.173421 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd002916e_5145_4d9a_b074_a5f1ef2a1194.slice/crio-d308bc244ff1002a0717fff568e1cd9fd7d926f8e3d3ae7b151688237fb213ee WatchSource:0}: Error finding container d308bc244ff1002a0717fff568e1cd9fd7d926f8e3d3ae7b151688237fb213ee: Status 404 returned error can't find the container with id d308bc244ff1002a0717fff568e1cd9fd7d926f8e3d3ae7b151688237fb213ee Jul 24 14:32:52.261054 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.261024 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mc5kt"] Jul 24 14:32:52.266429 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:32:52.266402 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2238818_2359_4792_9170_4294d907f0dc.slice/crio-a3a49f4292154ed3a6379c80e23b560bdc3d21092569064add8e1f156741781b WatchSource:0}: Error finding container a3a49f4292154ed3a6379c80e23b560bdc3d21092569064add8e1f156741781b: Status 404 returned error can't find the container with id a3a49f4292154ed3a6379c80e23b560bdc3d21092569064add8e1f156741781b Jul 24 14:32:52.416441 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.415505 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k7w5x" event={"ID":"33267e5b-9b26-472f-8b36-6fc795d5131d","Type":"ContainerStarted","Data":"3c22160c8cbf303b899a5a7e734fb86d89679e0d2ac7183cea774eecb9ab8ea0"} Jul 24 14:32:52.416441 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.415587 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k7w5x" event={"ID":"33267e5b-9b26-472f-8b36-6fc795d5131d","Type":"ContainerStarted","Data":"d18332aec33b590c3fdcacf175a588b9d52a5ba84418009b2357115d86f6688f"} Jul 24 14:32:52.416441 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.416348 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:32:52.424593 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.424485 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qqwbj" event={"ID":"2d12d587-003d-4a55-b730-17a03d9ab3f9","Type":"ContainerStarted","Data":"d50bafee3c69608db9898a00d228772d0104af80988e1799deb42a7c55104988"} Jul 24 14:32:52.427591 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.427000 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55c8f8654c-n89nb" event={"ID":"22f5a108-29e1-475b-a485-f5b42c371cb9","Type":"ContainerStarted","Data":"9dbbb1f7d32887648ce9e9873ec4e9b1e7f032367e45eb5955c7b87b76f41c83"} Jul 24 14:32:52.427591 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.427047 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55c8f8654c-n89nb" event={"ID":"22f5a108-29e1-475b-a485-f5b42c371cb9","Type":"ContainerStarted","Data":"0b7c0f4f166e1846a19c7df6d3d7bba6bee0e5c66d15a1c74cc6111fe2b60fef"} Jul 24 14:32:52.429933 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.429864 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2p6b9" event={"ID":"7ca81320-80de-485a-8225-cc323e3cefc8","Type":"ContainerStarted","Data":"a88c5781ccd1cb1d4076b275bf64d37896e87d3875d758f81f1cef447f9e0f75"} Jul 24 14:32:52.434238 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.431908 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" event={"ID":"fded2848-bd46-4040-94c3-ac7b1a47126b","Type":"ContainerStarted","Data":"31851d0e4a134a844cc00ecd424977055fa1835e5125f3aa4f1a91615d7b8729"} Jul 24 14:32:52.434238 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.433759 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k7w5x" podStartSLOduration=67.433741384 podStartE2EDuration="1m7.433741384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:31:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:52.43213636 +0000 UTC m=+67.989052253" watchObservedRunningTime="2026-07-24 14:32:52.433741384 +0000 UTC m=+67.990657277" Jul 24 14:32:52.437007 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.436926 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7s68w" event={"ID":"22897615-e1fd-4eb7-9694-81b23695e7a5","Type":"ContainerStarted","Data":"3ac0eaa15f67ceec06f070e0478d5a4d536e90d57a4dde364cb7a526cca7d59f"} Jul 24 14:32:52.439738 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.439622 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" event={"ID":"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf","Type":"ContainerStarted","Data":"5a14c9cbf9b9cb3d8367c7496650d1642d9f225e88f6912e7c6763c4217343b5"} Jul 24 14:32:52.439738 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.439671 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" event={"ID":"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf","Type":"ContainerStarted","Data":"7eb13ce72a0fb91fc8aaf2f87754f0056a2666e74dc5fb7ae6c03faf35248d32"} Jul 24 14:32:52.439738 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.439708 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:32:52.444874 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.444807 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" event={"ID":"d002916e-5145-4d9a-b074-a5f1ef2a1194","Type":"ContainerStarted","Data":"d308bc244ff1002a0717fff568e1cd9fd7d926f8e3d3ae7b151688237fb213ee"} Jul 24 14:32:52.447207 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.447106 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mc5kt" event={"ID":"e2238818-2359-4792-9170-4294d907f0dc","Type":"ContainerStarted","Data":"a3a49f4292154ed3a6379c80e23b560bdc3d21092569064add8e1f156741781b"} Jul 24 14:32:52.452095 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.451127 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-55c8f8654c-n89nb" podStartSLOduration=38.451115462 podStartE2EDuration="38.451115462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:52.450568738 +0000 UTC m=+68.007484631" watchObservedRunningTime="2026-07-24 14:32:52.451115462 +0000 UTC m=+68.008031353" Jul 24 14:32:52.473614 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.472049 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" podStartSLOduration=67.472029543 podStartE2EDuration="1m7.472029543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:31:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:52.470995516 +0000 UTC m=+68.027911422" watchObservedRunningTime="2026-07-24 14:32:52.472029543 +0000 UTC m=+68.028945436" Jul 24 14:32:52.938789 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.938741 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:52.941958 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:52.941752 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:53.455727 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:53.455635 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:53.457312 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:53.457283 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-55c8f8654c-n89nb" Jul 24 14:32:53.967460 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:53.966992 2581 scope.go:117] "RemoveContainer" containerID="1c85ea7595e37616eef34e8d90676e29ef44f12979127082d623831918fa7d92" Jul 24 14:32:54.058153 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:54.058084 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hsh7p\" (UID: \"bea90f67-deec-4a7b-97ec-6491657a3019\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" Jul 24 14:32:54.061264 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:54.061218 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bea90f67-deec-4a7b-97ec-6491657a3019-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-hsh7p\" (UID: \"bea90f67-deec-4a7b-97ec-6491657a3019\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" Jul 24 14:32:54.210191 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:54.210157 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wjp2v\"" Jul 24 14:32:54.218314 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:54.218245 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" Jul 24 14:32:54.460296 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:54.460256 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7s68w" event={"ID":"22897615-e1fd-4eb7-9694-81b23695e7a5","Type":"ContainerStarted","Data":"880d767781dd297b6e962c10f1c84af5546b6c0f78c2ab932d8613c43b5875a8"} Jul 24 14:32:54.460461 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:54.460328 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7s68w" event={"ID":"22897615-e1fd-4eb7-9694-81b23695e7a5","Type":"ContainerStarted","Data":"17a54a4698ef297a8e4e6a9cd37743c12c6a0077cb4bdba3225b1f90b9a041bc"} Jul 24 14:32:54.479338 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:54.479282 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7s68w" podStartSLOduration=68.122580729 podStartE2EDuration="1m9.479256998s" totalImagesPullingTime="1.356676269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:32:54.478507859 +0000 UTC m=+70.035423753" watchObservedRunningTime="2026-07-24 14:32:54.479256998 +0000 UTC m=+70.036172889" Jul 24 14:32:55.026011 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.025978 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq"] Jul 24 14:32:55.033380 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.033352 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8"] Jul 24 14:32:55.033599 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.033560 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq" Jul 24 14:32:55.035485 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.035464 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8" Jul 24 14:32:55.040636 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.039584 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 24 14:32:55.043555 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.041198 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 24 14:32:55.043555 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.042306 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf"] Jul 24 14:32:55.043555 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.042436 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 24 14:32:55.043555 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.042716 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bsw72\"" Jul 24 14:32:55.043555 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.042924 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 24 14:32:55.044134 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.043975 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 24 14:32:55.048031 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.048010 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq"] Jul 24 14:32:55.048132 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.048044 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8"] Jul 24 14:32:55.048180 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.048145 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.053100 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.052666 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 24 14:32:55.053100 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.052695 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 24 14:32:55.053100 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.052826 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 24 14:32:55.053100 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.052945 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 24 14:32:55.071294 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.071259 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf"] Jul 24 14:32:55.168810 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.168772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9c85c3b3-3eff-4c72-8984-cff053ccf08a-ca\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.169001 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.168826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtdzk\" (UniqueName: \"kubernetes.io/projected/db195ed7-33b3-4b8f-be0e-ab2aaca13bfc-kube-api-access-xtdzk\") pod \"klusterlet-addon-workmgr-b877c65bc-kwzs8\" (UID: \"db195ed7-33b3-4b8f-be0e-ab2aaca13bfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8" Jul 24 14:32:55.169001 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.168861 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-478hk\" (UniqueName: \"kubernetes.io/projected/9c85c3b3-3eff-4c72-8984-cff053ccf08a-kube-api-access-478hk\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.169001 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.168880 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvvlp\" (UniqueName: \"kubernetes.io/projected/7e3cef0d-7cd5-4c2f-af9f-0b3858e5b440-kube-api-access-kvvlp\") pod \"managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq\" (UID: \"7e3cef0d-7cd5-4c2f-af9f-0b3858e5b440\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq" Jul 24 14:32:55.169001 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.168898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c85c3b3-3eff-4c72-8984-cff053ccf08a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.169001 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.168918 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e3cef0d-7cd5-4c2f-af9f-0b3858e5b440-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq\" (UID: \"7e3cef0d-7cd5-4c2f-af9f-0b3858e5b440\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq" Jul 24 14:32:55.169001 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.168944 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9c85c3b3-3eff-4c72-8984-cff053ccf08a-hub\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.169001 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.168979 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/db195ed7-33b3-4b8f-be0e-ab2aaca13bfc-klusterlet-config\") pod \"klusterlet-addon-workmgr-b877c65bc-kwzs8\" (UID: \"db195ed7-33b3-4b8f-be0e-ab2aaca13bfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8" Jul 24 14:32:55.169001 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.169000 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c85c3b3-3eff-4c72-8984-cff053ccf08a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.169404 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.169019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9c85c3b3-3eff-4c72-8984-cff053ccf08a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.169404 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.169077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db195ed7-33b3-4b8f-be0e-ab2aaca13bfc-tmp\") pod \"klusterlet-addon-workmgr-b877c65bc-kwzs8\" (UID: \"db195ed7-33b3-4b8f-be0e-ab2aaca13bfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8" Jul 24 14:32:55.270343 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.270236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtdzk\" (UniqueName: \"kubernetes.io/projected/db195ed7-33b3-4b8f-be0e-ab2aaca13bfc-kube-api-access-xtdzk\") pod \"klusterlet-addon-workmgr-b877c65bc-kwzs8\" (UID: \"db195ed7-33b3-4b8f-be0e-ab2aaca13bfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8" Jul 24 14:32:55.270343 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.270300 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-478hk\" (UniqueName: \"kubernetes.io/projected/9c85c3b3-3eff-4c72-8984-cff053ccf08a-kube-api-access-478hk\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.270343 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.270327 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvvlp\" (UniqueName: \"kubernetes.io/projected/7e3cef0d-7cd5-4c2f-af9f-0b3858e5b440-kube-api-access-kvvlp\") pod \"managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq\" (UID: \"7e3cef0d-7cd5-4c2f-af9f-0b3858e5b440\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq" Jul 24 14:32:55.270652 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.270355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c85c3b3-3eff-4c72-8984-cff053ccf08a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.270652 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.270378 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e3cef0d-7cd5-4c2f-af9f-0b3858e5b440-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq\" (UID: \"7e3cef0d-7cd5-4c2f-af9f-0b3858e5b440\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq" Jul 24 14:32:55.270652 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.270577 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9c85c3b3-3eff-4c72-8984-cff053ccf08a-hub\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.270652 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.270629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/db195ed7-33b3-4b8f-be0e-ab2aaca13bfc-klusterlet-config\") pod \"klusterlet-addon-workmgr-b877c65bc-kwzs8\" (UID: \"db195ed7-33b3-4b8f-be0e-ab2aaca13bfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8" Jul 24 14:32:55.270851 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.270667 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c85c3b3-3eff-4c72-8984-cff053ccf08a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.270851 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.270694 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9c85c3b3-3eff-4c72-8984-cff053ccf08a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.270851 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.270728 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db195ed7-33b3-4b8f-be0e-ab2aaca13bfc-tmp\") pod \"klusterlet-addon-workmgr-b877c65bc-kwzs8\" (UID: \"db195ed7-33b3-4b8f-be0e-ab2aaca13bfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8" Jul 24 14:32:55.270851 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.270800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9c85c3b3-3eff-4c72-8984-cff053ccf08a-ca\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.271690 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.271661 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db195ed7-33b3-4b8f-be0e-ab2aaca13bfc-tmp\") pod \"klusterlet-addon-workmgr-b877c65bc-kwzs8\" (UID: \"db195ed7-33b3-4b8f-be0e-ab2aaca13bfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8" Jul 24 14:32:55.272071 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.272045 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c85c3b3-3eff-4c72-8984-cff053ccf08a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.273796 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.273765 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c85c3b3-3eff-4c72-8984-cff053ccf08a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.273931 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.273885 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9c85c3b3-3eff-4c72-8984-cff053ccf08a-ca\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.274049 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.274025 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/db195ed7-33b3-4b8f-be0e-ab2aaca13bfc-klusterlet-config\") pod \"klusterlet-addon-workmgr-b877c65bc-kwzs8\" (UID: \"db195ed7-33b3-4b8f-be0e-ab2aaca13bfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8" Jul 24 14:32:55.274287 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.274244 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9c85c3b3-3eff-4c72-8984-cff053ccf08a-hub\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.275106 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.275079 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e3cef0d-7cd5-4c2f-af9f-0b3858e5b440-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq\" (UID: \"7e3cef0d-7cd5-4c2f-af9f-0b3858e5b440\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq" Jul 24 14:32:55.275237 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.275209 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9c85c3b3-3eff-4c72-8984-cff053ccf08a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.297547 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.297504 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-478hk\" (UniqueName: \"kubernetes.io/projected/9c85c3b3-3eff-4c72-8984-cff053ccf08a-kube-api-access-478hk\") pod \"cluster-proxy-proxy-agent-55496dbf7b-hckdf\" (UID: \"9c85c3b3-3eff-4c72-8984-cff053ccf08a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:32:55.298066 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.298043 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvvlp\" (UniqueName: \"kubernetes.io/projected/7e3cef0d-7cd5-4c2f-af9f-0b3858e5b440-kube-api-access-kvvlp\") pod \"managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq\" (UID: \"7e3cef0d-7cd5-4c2f-af9f-0b3858e5b440\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq" Jul 24 14:32:55.299147 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.299125 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtdzk\" (UniqueName: \"kubernetes.io/projected/db195ed7-33b3-4b8f-be0e-ab2aaca13bfc-kube-api-access-xtdzk\") pod \"klusterlet-addon-workmgr-b877c65bc-kwzs8\" (UID: \"db195ed7-33b3-4b8f-be0e-ab2aaca13bfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8" Jul 24 14:32:55.363628 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.363593 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq" Jul 24 14:32:55.377182 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.377147 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8" Jul 24 14:32:55.389686 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:32:55.389654 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" Jul 24 14:33:00.316551 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.316444 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p"] Jul 24 14:33:00.321992 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:33:00.321948 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea90f67_deec_4a7b_97ec_6491657a3019.slice/crio-356efa90718d3ddf2d5ff31995b166e223dac15856b44d3640a3a37cda7831eb WatchSource:0}: Error finding container 356efa90718d3ddf2d5ff31995b166e223dac15856b44d3640a3a37cda7831eb: Status 404 returned error can't find the container with id 356efa90718d3ddf2d5ff31995b166e223dac15856b44d3640a3a37cda7831eb Jul 24 14:33:00.450329 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.450278 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq"] Jul 24 14:33:00.452821 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:33:00.452797 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e3cef0d_7cd5_4c2f_af9f_0b3858e5b440.slice/crio-6fce4456bc9bf67a4b0be2198be78e83b988b9ccfb1199520d3ec3f374fc3e16 WatchSource:0}: Error finding container 6fce4456bc9bf67a4b0be2198be78e83b988b9ccfb1199520d3ec3f374fc3e16: Status 404 returned error can't find the container with id 6fce4456bc9bf67a4b0be2198be78e83b988b9ccfb1199520d3ec3f374fc3e16 Jul 24 14:33:00.463499 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.462382 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf"] Jul 24 14:33:00.464365 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.464314 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8"] Jul 24 14:33:00.468392 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:33:00.468358 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb195ed7_33b3_4b8f_be0e_ab2aaca13bfc.slice/crio-3bbaf3fbf3ccb35020a4fc37177ced5d3f7043aa40ebe1d3098168307265f0d4 WatchSource:0}: Error finding container 3bbaf3fbf3ccb35020a4fc37177ced5d3f7043aa40ebe1d3098168307265f0d4: Status 404 returned error can't find the container with id 3bbaf3fbf3ccb35020a4fc37177ced5d3f7043aa40ebe1d3098168307265f0d4 Jul 24 14:33:00.469287 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:33:00.469247 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c85c3b3_3eff_4c72_8984_cff053ccf08a.slice/crio-dca7bb0da440edf588bf7570c666e737d1288414652e6472ed6772a08a3915ce WatchSource:0}: Error finding container dca7bb0da440edf588bf7570c666e737d1288414652e6472ed6772a08a3915ce: Status 404 returned error can't find the container with id dca7bb0da440edf588bf7570c666e737d1288414652e6472ed6772a08a3915ce Jul 24 14:33:00.489285 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.489131 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qqwbj" event={"ID":"2d12d587-003d-4a55-b730-17a03d9ab3f9","Type":"ContainerStarted","Data":"581851b31dc6e03ab0d82ced534670ee4c0f54a9ceaed737e5108f95c05aed42"} Jul 24 14:33:00.491447 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.491415 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2p6b9" event={"ID":"7ca81320-80de-485a-8225-cc323e3cefc8","Type":"ContainerStarted","Data":"0f71756575b9fcc88236ea058f8d65305c554954e84ba5684a655d162cabdb6e"} Jul 24 14:33:00.498127 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.498089 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq" event={"ID":"7e3cef0d-7cd5-4c2f-af9f-0b3858e5b440","Type":"ContainerStarted","Data":"6fce4456bc9bf67a4b0be2198be78e83b988b9ccfb1199520d3ec3f374fc3e16"} Jul 24 14:33:00.499559 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.499491 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" event={"ID":"bea90f67-deec-4a7b-97ec-6491657a3019","Type":"ContainerStarted","Data":"356efa90718d3ddf2d5ff31995b166e223dac15856b44d3640a3a37cda7831eb"} Jul 24 14:33:00.501848 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.501766 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" event={"ID":"fded2848-bd46-4040-94c3-ac7b1a47126b","Type":"ContainerStarted","Data":"9ab48ee142fbabf037ce9abad0915f6bed2ae1d8209731db57ad61cf114885c0"} Jul 24 14:33:00.501848 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.501809 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" event={"ID":"fded2848-bd46-4040-94c3-ac7b1a47126b","Type":"ContainerStarted","Data":"ee3235f2a4258b4cf239cc30812edc3c9949850dbddc7c330c870012d6ca128c"} Jul 24 14:33:00.503213 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.503164 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" event={"ID":"9c85c3b3-3eff-4c72-8984-cff053ccf08a","Type":"ContainerStarted","Data":"dca7bb0da440edf588bf7570c666e737d1288414652e6472ed6772a08a3915ce"} Jul 24 14:33:00.505685 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.505645 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" event={"ID":"d002916e-5145-4d9a-b074-a5f1ef2a1194","Type":"ContainerStarted","Data":"1c70e8085dc262682746de5a1dd63501267d286339ffd39c99177f7995209357"} Jul 24 14:33:00.509510 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.507943 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 14:33:00.509510 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.508004 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" event={"ID":"eeddf5b7-07cf-421b-a168-5b67bbb239f1","Type":"ContainerStarted","Data":"6f08a4f1233d294941be7484e9b12caf25746ef546830044e0add93077a984e2"} Jul 24 14:33:00.509510 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.508587 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:33:00.510605 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.510559 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8" event={"ID":"db195ed7-33b3-4b8f-be0e-ab2aaca13bfc","Type":"ContainerStarted","Data":"3bbaf3fbf3ccb35020a4fc37177ced5d3f7043aa40ebe1d3098168307265f0d4"} Jul 24 14:33:00.513824 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.513804 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mc5kt" event={"ID":"e2238818-2359-4792-9170-4294d907f0dc","Type":"ContainerStarted","Data":"9007718017a482566286bd7ad797253c9b08314000be6a8e6f8f57516f85553f"} Jul 24 14:33:00.513908 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.513841 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mc5kt" event={"ID":"e2238818-2359-4792-9170-4294d907f0dc","Type":"ContainerStarted","Data":"81c137f40185c07c4a7c979b3e452e2eb31db4714f8945fdc0e6fc49918eb987"} Jul 24 14:33:00.514246 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.514231 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mc5kt" Jul 24 14:33:00.552263 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.552086 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2p6b9" podStartSLOduration=67.323062939 podStartE2EDuration="1m15.552068932s" totalImagesPullingTime="8.229005993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:00.550465526 +0000 UTC m=+76.107381417" watchObservedRunningTime="2026-07-24 14:33:00.552068932 +0000 UTC m=+76.108984828" Jul 24 14:33:00.589862 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.589814 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qfnzw" podStartSLOduration=38.817308234 podStartE2EDuration="46.589799667s" totalImagesPullingTime="7.772491433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:00.588369306 +0000 UTC m=+76.145285197" watchObservedRunningTime="2026-07-24 14:33:00.589799667 +0000 UTC m=+76.146715559" Jul 24 14:33:00.644959 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.644904 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m72p4" podStartSLOduration=38.824203211 podStartE2EDuration="46.644886502s" totalImagesPullingTime="7.820683291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:00.643691328 +0000 UTC m=+76.200607222" watchObservedRunningTime="2026-07-24 14:33:00.644886502 +0000 UTC m=+76.201802393" Jul 24 14:33:00.730629 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.730509 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mc5kt" podStartSLOduration=34.066575236 podStartE2EDuration="41.730491672s" totalImagesPullingTime="7.663916436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:00.688467004 +0000 UTC m=+76.245382896" watchObservedRunningTime="2026-07-24 14:33:00.730491672 +0000 UTC m=+76.287407567" Jul 24 14:33:00.731002 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:00.730979 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" podStartSLOduration=37.217038892 podStartE2EDuration="46.730973002s" totalImagesPullingTime="9.51393411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:00.729427684 +0000 UTC m=+76.286343578" watchObservedRunningTime="2026-07-24 14:33:00.730973002 +0000 UTC m=+76.287888944" Jul 24 14:33:01.036770 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:01.036738 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-pn96s" Jul 24 14:33:09.565905 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:09.565863 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" event={"ID":"9c85c3b3-3eff-4c72-8984-cff053ccf08a","Type":"ContainerStarted","Data":"e6b9e49bac2751f73743176d835618b8796f7804f63492f339f1badaa380447a"} Jul 24 14:33:09.566367 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:09.565916 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" event={"ID":"9c85c3b3-3eff-4c72-8984-cff053ccf08a","Type":"ContainerStarted","Data":"a8a7e0d40d6855e8155fe8d1379f3588275c49d04369acdf20b651e91f0adf39"} Jul 24 14:33:09.566367 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:09.565936 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" event={"ID":"9c85c3b3-3eff-4c72-8984-cff053ccf08a","Type":"ContainerStarted","Data":"c05f4bdb6d01ce99e54c959533f6a42f84e4950902233d89abae08bd5da95897"} Jul 24 14:33:09.567574 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:09.567518 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8" event={"ID":"db195ed7-33b3-4b8f-be0e-ab2aaca13bfc","Type":"ContainerStarted","Data":"05a09d60c675e13937ef93191bb770f5b1b432ad1cab63e0501678e246a92d0c"} Jul 24 14:33:09.567718 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:09.567606 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8" Jul 24 14:33:09.569160 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:09.569137 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8" Jul 24 14:33:09.569865 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:09.569844 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qqwbj" event={"ID":"2d12d587-003d-4a55-b730-17a03d9ab3f9","Type":"ContainerStarted","Data":"815ae32d7eb02e9971bfe6df74c9147cb2f6ed2f74065d438cfe6d025ad3cb2d"} Jul 24 14:33:09.571315 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:09.571280 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq" event={"ID":"7e3cef0d-7cd5-4c2f-af9f-0b3858e5b440","Type":"ContainerStarted","Data":"ece0d6b92f7cfd9b3923d31f71210fb6b7290a1aadbd885029f349cde097415a"} Jul 24 14:33:09.572645 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:09.572626 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" event={"ID":"bea90f67-deec-4a7b-97ec-6491657a3019","Type":"ContainerStarted","Data":"fcdead2d47221bf4c6c2fda8f90e9e5dd5e804b4142956f70052107c456a66cf"} Jul 24 14:33:09.588017 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:09.587967 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55496dbf7b-hckdf" podStartSLOduration=6.392763969 podStartE2EDuration="14.587955357s" totalImagesPullingTime="8.195191388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:09.586158713 +0000 UTC m=+85.143074596" watchObservedRunningTime="2026-07-24 14:33:09.587955357 +0000 UTC m=+85.144871227" Jul 24 14:33:09.608890 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:09.608840 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qqwbj" podStartSLOduration=18.250113465 podStartE2EDuration="39.608827405s" totalImagesPullingTime="21.35871394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:32:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:09.607662176 +0000 UTC m=+85.164578079" watchObservedRunningTime="2026-07-24 14:33:09.608827405 +0000 UTC m=+85.165743296" Jul 24 14:33:09.628753 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:09.628702 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5cfd8bbd-fmlnq" podStartSLOduration=7.434569435 podStartE2EDuration="15.628687966s" totalImagesPullingTime="8.194118531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:09.627473618 +0000 UTC m=+85.184389510" watchObservedRunningTime="2026-07-24 14:33:09.628687966 +0000 UTC m=+85.185603858" Jul 24 14:33:09.645393 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:09.645349 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-hsh7p" podStartSLOduration=39.332388134 podStartE2EDuration="47.645336452s" totalImagesPullingTime="8.312948318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:09.644177104 +0000 UTC m=+85.201092997" watchObservedRunningTime="2026-07-24 14:33:09.645336452 +0000 UTC m=+85.202252337" Jul 24 14:33:09.661693 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:09.661629 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b877c65bc-kwzs8" podStartSLOduration=7.461876634 podStartE2EDuration="15.661607182s" totalImagesPullingTime="8.199730548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:32:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:09.659625255 +0000 UTC m=+85.216541148" watchObservedRunningTime="2026-07-24 14:33:09.661607182 +0000 UTC m=+85.218523075" Jul 24 14:33:11.532301 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:11.532266 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mc5kt" Jul 24 14:33:11.886102 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:11.886021 2581 patch_prober.go:28] interesting pod/image-registry-6bbb7bd6cb-99gms container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 24 14:33:11.886102 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:11.886080 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" podUID="c3d6f109-433f-4b97-b6f7-b42bb7cc79cf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 14:33:13.458868 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:13.458837 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:33:14.323882 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.323847 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qtjnt"] Jul 24 14:33:14.326809 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.326788 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.329713 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.329687 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 14:33:14.330172 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.330154 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 14:33:14.331367 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.331325 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r2rmr\"" Jul 24 14:33:14.331628 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.331591 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 14:33:14.331628 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.331615 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 14:33:14.441705 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.441667 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/129b2f00-f66b-4a5a-85ed-af4d77638bfe-node-exporter-accelerators-collector-config\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.441884 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.441723 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/129b2f00-f66b-4a5a-85ed-af4d77638bfe-sys\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.441884 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.441751 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/129b2f00-f66b-4a5a-85ed-af4d77638bfe-node-exporter-tls\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.441884 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.441783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/129b2f00-f66b-4a5a-85ed-af4d77638bfe-metrics-client-ca\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.441884 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.441811 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zddz\" (UniqueName: \"kubernetes.io/projected/129b2f00-f66b-4a5a-85ed-af4d77638bfe-kube-api-access-4zddz\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.442008 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.441905 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/129b2f00-f66b-4a5a-85ed-af4d77638bfe-node-exporter-wtmp\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.442008 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.441956 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/129b2f00-f66b-4a5a-85ed-af4d77638bfe-node-exporter-textfile\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.442067 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.442013 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/129b2f00-f66b-4a5a-85ed-af4d77638bfe-root\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.442067 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.442038 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/129b2f00-f66b-4a5a-85ed-af4d77638bfe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.542936 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.542903 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/129b2f00-f66b-4a5a-85ed-af4d77638bfe-node-exporter-wtmp\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.543369 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.542945 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/129b2f00-f66b-4a5a-85ed-af4d77638bfe-node-exporter-textfile\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.543369 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.542971 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/129b2f00-f66b-4a5a-85ed-af4d77638bfe-root\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.543369 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.542992 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/129b2f00-f66b-4a5a-85ed-af4d77638bfe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.543369 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.543035 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/129b2f00-f66b-4a5a-85ed-af4d77638bfe-node-exporter-accelerators-collector-config\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.543369 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.543069 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/129b2f00-f66b-4a5a-85ed-af4d77638bfe-sys\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.543369 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.543087 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/129b2f00-f66b-4a5a-85ed-af4d77638bfe-root\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.543369 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.543087 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/129b2f00-f66b-4a5a-85ed-af4d77638bfe-node-exporter-wtmp\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.543369 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.543125 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/129b2f00-f66b-4a5a-85ed-af4d77638bfe-sys\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.543369 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.543181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/129b2f00-f66b-4a5a-85ed-af4d77638bfe-node-exporter-tls\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.543369 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.543225 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/129b2f00-f66b-4a5a-85ed-af4d77638bfe-metrics-client-ca\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.543369 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.543253 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zddz\" (UniqueName: \"kubernetes.io/projected/129b2f00-f66b-4a5a-85ed-af4d77638bfe-kube-api-access-4zddz\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.543902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.543450 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/129b2f00-f66b-4a5a-85ed-af4d77638bfe-node-exporter-textfile\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.543902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.543779 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/129b2f00-f66b-4a5a-85ed-af4d77638bfe-node-exporter-accelerators-collector-config\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.543902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.543846 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/129b2f00-f66b-4a5a-85ed-af4d77638bfe-metrics-client-ca\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.545520 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.545501 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/129b2f00-f66b-4a5a-85ed-af4d77638bfe-node-exporter-tls\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.545846 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.545830 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/129b2f00-f66b-4a5a-85ed-af4d77638bfe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.551031 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.551009 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zddz\" (UniqueName: \"kubernetes.io/projected/129b2f00-f66b-4a5a-85ed-af4d77638bfe-kube-api-access-4zddz\") pod \"node-exporter-qtjnt\" (UID: \"129b2f00-f66b-4a5a-85ed-af4d77638bfe\") " pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.636932 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:14.636838 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qtjnt" Jul 24 14:33:14.649055 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:33:14.649028 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod129b2f00_f66b_4a5a_85ed_af4d77638bfe.slice/crio-7e9bbb2ad39a68f5ad188e97739fd30dd3b600bd54d01829ac7301747311fc51 WatchSource:0}: Error finding container 7e9bbb2ad39a68f5ad188e97739fd30dd3b600bd54d01829ac7301747311fc51: Status 404 returned error can't find the container with id 7e9bbb2ad39a68f5ad188e97739fd30dd3b600bd54d01829ac7301747311fc51 Jul 24 14:33:15.599470 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:15.599432 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtjnt" event={"ID":"129b2f00-f66b-4a5a-85ed-af4d77638bfe","Type":"ContainerStarted","Data":"7e9bbb2ad39a68f5ad188e97739fd30dd3b600bd54d01829ac7301747311fc51"} Jul 24 14:33:16.605116 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:16.605080 2581 generic.go:356] "Generic (PLEG): container finished" podID="129b2f00-f66b-4a5a-85ed-af4d77638bfe" containerID="f2af24ffe5393ad752b8f7561cbe9079f758ef87a3e57d7c0d388d1657811dcf" exitCode=0 Jul 24 14:33:16.605631 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:16.605145 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtjnt" event={"ID":"129b2f00-f66b-4a5a-85ed-af4d77638bfe","Type":"ContainerDied","Data":"f2af24ffe5393ad752b8f7561cbe9079f758ef87a3e57d7c0d388d1657811dcf"} Jul 24 14:33:17.611681 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:17.611645 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtjnt" event={"ID":"129b2f00-f66b-4a5a-85ed-af4d77638bfe","Type":"ContainerStarted","Data":"275c96a29bf0691dabdb16d73c11d82cf9565d143c5b2466c75972c42591f88f"} Jul 24 14:33:17.612089 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:17.611711 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtjnt" event={"ID":"129b2f00-f66b-4a5a-85ed-af4d77638bfe","Type":"ContainerStarted","Data":"98d42ec870dacd34446392a97ecf656a35a4c60adbc0e38323ad6990eb6c3c82"} Jul 24 14:33:17.654062 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:17.654012 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qtjnt" podStartSLOduration=2.461465704 podStartE2EDuration="3.653992982s" totalImagesPullingTime="1.123021302s" totalInitContainerRuntime="69.505976ms" isStatefulPod=true podCreationTimestamp="2026-07-24 14:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:33:17.653041753 +0000 UTC m=+93.209957647" watchObservedRunningTime="2026-07-24 14:33:17.653992982 +0000 UTC m=+93.210908876" Jul 24 14:33:19.463916 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:19.463882 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bbb7bd6cb-99gms"] Jul 24 14:33:24.463142 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:24.463109 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k7w5x" Jul 24 14:33:41.705829 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:41.705783 2581 generic.go:356] "Generic (PLEG): container finished" podID="1ba79270-3bec-4c43-97f2-3313aed19503" containerID="5af38858c6f032ced7a5b2c8ebac3dba4b159555d47259f66a0bbef22af56af0" exitCode=0 Jul 24 14:33:41.706261 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:41.705846 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-jx44r" event={"ID":"1ba79270-3bec-4c43-97f2-3313aed19503","Type":"ContainerDied","Data":"5af38858c6f032ced7a5b2c8ebac3dba4b159555d47259f66a0bbef22af56af0"} Jul 24 14:33:41.706261 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:41.706254 2581 scope.go:117] "RemoveContainer" containerID="5af38858c6f032ced7a5b2c8ebac3dba4b159555d47259f66a0bbef22af56af0" Jul 24 14:33:41.707393 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:41.707372 2581 generic.go:356] "Generic (PLEG): container finished" podID="34244aba-7d82-4b4e-aac5-216ee4e6bbaa" containerID="856012d2ad8240bd9d03f77988fc9df253d8e014b492a867ef79b775c4befd63" exitCode=0 Jul 24 14:33:41.707463 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:41.707444 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w" event={"ID":"34244aba-7d82-4b4e-aac5-216ee4e6bbaa","Type":"ContainerDied","Data":"856012d2ad8240bd9d03f77988fc9df253d8e014b492a867ef79b775c4befd63"} Jul 24 14:33:41.707736 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:41.707722 2581 scope.go:117] "RemoveContainer" containerID="856012d2ad8240bd9d03f77988fc9df253d8e014b492a867ef79b775c4befd63" Jul 24 14:33:42.713726 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:42.713696 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-jx44r" event={"ID":"1ba79270-3bec-4c43-97f2-3313aed19503","Type":"ContainerStarted","Data":"ac8ea0f11df1182b56a3cdb3f6c3719dcdaac6bb16724e7505ad87e9afd78304"} Jul 24 14:33:42.715585 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:42.715557 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w" event={"ID":"34244aba-7d82-4b4e-aac5-216ee4e6bbaa","Type":"ContainerStarted","Data":"92f5aa19c4cbb32762533b344a553bb920b16303102dadc2a6d7721d83131aa9"} Jul 24 14:33:44.483928 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.483890 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" podUID="c3d6f109-433f-4b97-b6f7-b42bb7cc79cf" containerName="registry" containerID="cri-o://5a14c9cbf9b9cb3d8367c7496650d1642d9f225e88f6912e7c6763c4217343b5" gracePeriod=30 Jul 24 14:33:44.725954 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.725888 2581 generic.go:356] "Generic (PLEG): container finished" podID="c3d6f109-433f-4b97-b6f7-b42bb7cc79cf" containerID="5a14c9cbf9b9cb3d8367c7496650d1642d9f225e88f6912e7c6763c4217343b5" exitCode=0 Jul 24 14:33:44.726079 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.726025 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" event={"ID":"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf","Type":"ContainerDied","Data":"5a14c9cbf9b9cb3d8367c7496650d1642d9f225e88f6912e7c6763c4217343b5"} Jul 24 14:33:44.726178 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.726149 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" event={"ID":"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf","Type":"ContainerDied","Data":"7eb13ce72a0fb91fc8aaf2f87754f0056a2666e74dc5fb7ae6c03faf35248d32"} Jul 24 14:33:44.726231 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.726200 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7eb13ce72a0fb91fc8aaf2f87754f0056a2666e74dc5fb7ae6c03faf35248d32" Jul 24 14:33:44.737265 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.737206 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:33:44.795422 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.795389 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbr7h\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-kube-api-access-vbr7h\") pod \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " Jul 24 14:33:44.795602 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.795436 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-ca-trust-extracted\") pod \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " Jul 24 14:33:44.795602 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.795457 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-installation-pull-secrets\") pod \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " Jul 24 14:33:44.795700 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.795632 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls\") pod \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " Jul 24 14:33:44.795700 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.795677 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-image-registry-private-configuration\") pod \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " Jul 24 14:33:44.795801 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.795739 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-trusted-ca\") pod \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " Jul 24 14:33:44.795801 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.795770 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-bound-sa-token\") pod \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " Jul 24 14:33:44.795904 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.795863 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-certificates\") pod \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\" (UID: \"c3d6f109-433f-4b97-b6f7-b42bb7cc79cf\") " Jul 24 14:33:44.796514 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.796485 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf" (UID: "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:33:44.796721 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.796568 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf" (UID: "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:33:44.798080 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.798052 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-kube-api-access-vbr7h" (OuterVolumeSpecName: "kube-api-access-vbr7h") pod "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf" (UID: "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf"). InnerVolumeSpecName "kube-api-access-vbr7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:33:44.798207 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.798088 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf" (UID: "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:33:44.798207 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.798165 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf" (UID: "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:33:44.798291 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.798261 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf" (UID: "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:33:44.798386 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.798361 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf" (UID: "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:33:44.803917 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.803896 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf" (UID: "c3d6f109-433f-4b97-b6f7-b42bb7cc79cf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:33:44.896941 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.896914 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-trusted-ca\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:33:44.896941 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.896937 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-bound-sa-token\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:33:44.896941 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.896947 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-certificates\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:33:44.897154 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.896956 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbr7h\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-kube-api-access-vbr7h\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:33:44.897154 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.896965 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-ca-trust-extracted\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:33:44.897154 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.896973 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-installation-pull-secrets\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:33:44.897154 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.896981 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-registry-tls\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:33:44.897154 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:44.896990 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf-image-registry-private-configuration\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:33:45.730106 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:45.730075 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bbb7bd6cb-99gms" Jul 24 14:33:45.748629 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:45.748596 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bbb7bd6cb-99gms"] Jul 24 14:33:45.754983 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:45.754956 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bbb7bd6cb-99gms"] Jul 24 14:33:46.735433 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:46.735398 2581 generic.go:356] "Generic (PLEG): container finished" podID="0f122507-6dec-43f9-872f-fba90dbc59ea" containerID="4618609c2020c4b7b2df8489b8156bf495de813a7feac61b967ce166848bfe5d" exitCode=0 Jul 24 14:33:46.735947 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:46.735480 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc" event={"ID":"0f122507-6dec-43f9-872f-fba90dbc59ea","Type":"ContainerDied","Data":"4618609c2020c4b7b2df8489b8156bf495de813a7feac61b967ce166848bfe5d"} Jul 24 14:33:46.735947 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:46.735821 2581 scope.go:117] "RemoveContainer" containerID="4618609c2020c4b7b2df8489b8156bf495de813a7feac61b967ce166848bfe5d" Jul 24 14:33:46.977181 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:46.977145 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3d6f109-433f-4b97-b6f7-b42bb7cc79cf" path="/var/lib/kubelet/pods/c3d6f109-433f-4b97-b6f7-b42bb7cc79cf/volumes" Jul 24 14:33:47.740748 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:33:47.740706 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-x75xc" event={"ID":"0f122507-6dec-43f9-872f-fba90dbc59ea","Type":"ContainerStarted","Data":"6b601da4d174dddbcb564900b0377c8a5093f0d2d84bd9ccb885a2718296563f"} Jul 24 14:36:38.473207 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.473173 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l"] Jul 24 14:36:38.473654 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.473491 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d6f109-433f-4b97-b6f7-b42bb7cc79cf" containerName="registry" Jul 24 14:36:38.473654 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.473502 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d6f109-433f-4b97-b6f7-b42bb7cc79cf" containerName="registry" Jul 24 14:36:38.473654 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.473585 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3d6f109-433f-4b97-b6f7-b42bb7cc79cf" containerName="registry" Jul 24 14:36:38.475442 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.475425 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.478367 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.478343 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 24 14:36:38.481887 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.481864 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 24 14:36:38.486480 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.482055 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p884f\"" Jul 24 14:36:38.486480 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.482156 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 14:36:38.486480 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.482311 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 14:36:38.494967 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.494942 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gk7v\" (UniqueName: \"kubernetes.io/projected/04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0-kube-api-access-5gk7v\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l\" (UID: \"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.495062 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.494988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0-tmp\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l\" (UID: \"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.495062 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.495005 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l\" (UID: \"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.495172 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.495052 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l\" (UID: \"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.495224 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.495158 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0-manifests\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l\" (UID: \"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.501956 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.501935 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l"] Jul 24 14:36:38.595888 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.595847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0-tmp\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l\" (UID: \"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.595888 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.595889 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l\" (UID: \"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.596128 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.595914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l\" (UID: \"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.596128 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.595950 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0-manifests\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l\" (UID: \"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.596128 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.596020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gk7v\" (UniqueName: \"kubernetes.io/projected/04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0-kube-api-access-5gk7v\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l\" (UID: \"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.596472 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.596443 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0-manifests\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l\" (UID: \"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.598198 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.598176 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0-tmp\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l\" (UID: \"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.598466 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.598436 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l\" (UID: \"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.598580 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.598517 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l\" (UID: \"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.608138 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.608113 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gk7v\" (UniqueName: \"kubernetes.io/projected/04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0-kube-api-access-5gk7v\") pod \"opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l\" (UID: \"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0\") " pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.788175 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.788142 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:38.926357 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:38.926322 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l"] Jul 24 14:36:38.929035 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:36:38.929009 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c5cfc3_d2c4_49d1_b859_4f7b020bcfe0.slice/crio-b77a09973a117d40744534cc080931ddecad9fb26e45f3b8eaffe9b82d526a2c WatchSource:0}: Error finding container b77a09973a117d40744534cc080931ddecad9fb26e45f3b8eaffe9b82d526a2c: Status 404 returned error can't find the container with id b77a09973a117d40744534cc080931ddecad9fb26e45f3b8eaffe9b82d526a2c Jul 24 14:36:39.380487 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:39.380451 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" event={"ID":"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0","Type":"ContainerStarted","Data":"b77a09973a117d40744534cc080931ddecad9fb26e45f3b8eaffe9b82d526a2c"} Jul 24 14:36:42.396388 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:42.396298 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" event={"ID":"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0","Type":"ContainerStarted","Data":"6e29af949d4dcbe2a06760475daad0e48ee7166af4bd0e9a9af48903bb539981"} Jul 24 14:36:43.404663 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:43.404575 2581 generic.go:356] "Generic (PLEG): container finished" podID="04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0" containerID="6e29af949d4dcbe2a06760475daad0e48ee7166af4bd0e9a9af48903bb539981" exitCode=0 Jul 24 14:36:43.404663 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:43.404624 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" event={"ID":"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0","Type":"ContainerDied","Data":"6e29af949d4dcbe2a06760475daad0e48ee7166af4bd0e9a9af48903bb539981"} Jul 24 14:36:44.415968 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:44.415867 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" event={"ID":"04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0","Type":"ContainerStarted","Data":"b1ce044f45ea7434dda35698a712bcf447c0703cdca752f49cee69928ddc0e50"} Jul 24 14:36:44.416371 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:44.415991 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:36:44.441556 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:44.441491 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" podStartSLOduration=1.526934156 podStartE2EDuration="6.44147502s" totalImagesPullingTime="3.855842596s" totalInitContainerRuntime="1.058698268s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:44.440661788 +0000 UTC m=+299.997577691" watchObservedRunningTime="2026-07-24 14:36:44.44147502 +0000 UTC m=+299.998390912" Jul 24 14:36:44.863192 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:44.863167 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 14:36:44.868447 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:44.868421 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 14:36:44.871478 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:44.871454 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 14:36:44.875766 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:44.875741 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 14:36:44.877145 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:44.877126 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 14:36:55.422316 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:36:55.422282 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l" Jul 24 14:37:00.881203 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:00.881158 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn"] Jul 24 14:37:00.883657 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:00.883635 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn" Jul 24 14:37:00.886422 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:00.886399 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 24 14:37:00.886422 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:00.886417 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 24 14:37:00.897751 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:00.897723 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn"] Jul 24 14:37:00.982731 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:00.982697 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5cd74e8-a47b-4246-afe0-2cce1b110f76-tls-certs\") pod \"kube-auth-proxy-55ffdfd896-vb7sn\" (UID: \"d5cd74e8-a47b-4246-afe0-2cce1b110f76\") " pod="openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn" Jul 24 14:37:00.982731 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:00.982728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5cd74e8-a47b-4246-afe0-2cce1b110f76-tmp\") pod \"kube-auth-proxy-55ffdfd896-vb7sn\" (UID: \"d5cd74e8-a47b-4246-afe0-2cce1b110f76\") " pod="openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn" Jul 24 14:37:00.982932 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:00.982805 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpqxn\" (UniqueName: \"kubernetes.io/projected/d5cd74e8-a47b-4246-afe0-2cce1b110f76-kube-api-access-hpqxn\") pod \"kube-auth-proxy-55ffdfd896-vb7sn\" (UID: \"d5cd74e8-a47b-4246-afe0-2cce1b110f76\") " pod="openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn" Jul 24 14:37:01.083388 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.083351 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5cd74e8-a47b-4246-afe0-2cce1b110f76-tls-certs\") pod \"kube-auth-proxy-55ffdfd896-vb7sn\" (UID: \"d5cd74e8-a47b-4246-afe0-2cce1b110f76\") " pod="openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn" Jul 24 14:37:01.083692 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.083659 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-c55zc"] Jul 24 14:37:01.083819 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.083668 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5cd74e8-a47b-4246-afe0-2cce1b110f76-tmp\") pod \"kube-auth-proxy-55ffdfd896-vb7sn\" (UID: \"d5cd74e8-a47b-4246-afe0-2cce1b110f76\") " pod="openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn" Jul 24 14:37:01.083976 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.083950 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpqxn\" (UniqueName: \"kubernetes.io/projected/d5cd74e8-a47b-4246-afe0-2cce1b110f76-kube-api-access-hpqxn\") pod \"kube-auth-proxy-55ffdfd896-vb7sn\" (UID: \"d5cd74e8-a47b-4246-afe0-2cce1b110f76\") " pod="openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn" Jul 24 14:37:01.085996 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.085977 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-c55zc" Jul 24 14:37:01.086437 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.086414 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5cd74e8-a47b-4246-afe0-2cce1b110f76-tmp\") pod \"kube-auth-proxy-55ffdfd896-vb7sn\" (UID: \"d5cd74e8-a47b-4246-afe0-2cce1b110f76\") " pod="openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn" Jul 24 14:37:01.086636 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.086618 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5cd74e8-a47b-4246-afe0-2cce1b110f76-tls-certs\") pod \"kube-auth-proxy-55ffdfd896-vb7sn\" (UID: \"d5cd74e8-a47b-4246-afe0-2cce1b110f76\") " pod="openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn" Jul 24 14:37:01.090512 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.090492 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xkxlb\"" Jul 24 14:37:01.090626 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.090543 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 24 14:37:01.106736 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.106674 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-c55zc"] Jul 24 14:37:01.118446 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.118422 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpqxn\" (UniqueName: \"kubernetes.io/projected/d5cd74e8-a47b-4246-afe0-2cce1b110f76-kube-api-access-hpqxn\") pod \"kube-auth-proxy-55ffdfd896-vb7sn\" (UID: \"d5cd74e8-a47b-4246-afe0-2cce1b110f76\") " pod="openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn" Jul 24 14:37:01.184972 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.184872 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9546a497-7d33-4318-9842-704564c2126b-cert\") pod \"odh-model-controller-7998c67dc4-c55zc\" (UID: \"9546a497-7d33-4318-9842-704564c2126b\") " pod="opendatahub/odh-model-controller-7998c67dc4-c55zc" Jul 24 14:37:01.184972 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.184926 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2q5w\" (UniqueName: \"kubernetes.io/projected/9546a497-7d33-4318-9842-704564c2126b-kube-api-access-t2q5w\") pod \"odh-model-controller-7998c67dc4-c55zc\" (UID: \"9546a497-7d33-4318-9842-704564c2126b\") " pod="opendatahub/odh-model-controller-7998c67dc4-c55zc" Jul 24 14:37:01.194461 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.194433 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn" Jul 24 14:37:01.286118 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.286083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9546a497-7d33-4318-9842-704564c2126b-cert\") pod \"odh-model-controller-7998c67dc4-c55zc\" (UID: \"9546a497-7d33-4318-9842-704564c2126b\") " pod="opendatahub/odh-model-controller-7998c67dc4-c55zc" Jul 24 14:37:01.286263 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.286126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2q5w\" (UniqueName: \"kubernetes.io/projected/9546a497-7d33-4318-9842-704564c2126b-kube-api-access-t2q5w\") pod \"odh-model-controller-7998c67dc4-c55zc\" (UID: \"9546a497-7d33-4318-9842-704564c2126b\") " pod="opendatahub/odh-model-controller-7998c67dc4-c55zc" Jul 24 14:37:01.289048 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.289002 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9546a497-7d33-4318-9842-704564c2126b-cert\") pod \"odh-model-controller-7998c67dc4-c55zc\" (UID: \"9546a497-7d33-4318-9842-704564c2126b\") " pod="opendatahub/odh-model-controller-7998c67dc4-c55zc" Jul 24 14:37:01.303959 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.303928 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2q5w\" (UniqueName: \"kubernetes.io/projected/9546a497-7d33-4318-9842-704564c2126b-kube-api-access-t2q5w\") pod \"odh-model-controller-7998c67dc4-c55zc\" (UID: \"9546a497-7d33-4318-9842-704564c2126b\") " pod="opendatahub/odh-model-controller-7998c67dc4-c55zc" Jul 24 14:37:01.336949 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.336924 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn"] Jul 24 14:37:01.339423 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:37:01.339397 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5cd74e8_a47b_4246_afe0_2cce1b110f76.slice/crio-5b8672d151785b1681602e636cc036965e3946b144cd2092a60e2e6dc620f5fa WatchSource:0}: Error finding container 5b8672d151785b1681602e636cc036965e3946b144cd2092a60e2e6dc620f5fa: Status 404 returned error can't find the container with id 5b8672d151785b1681602e636cc036965e3946b144cd2092a60e2e6dc620f5fa Jul 24 14:37:01.340965 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.340949 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 14:37:01.408923 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.408888 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-c55zc" Jul 24 14:37:01.489232 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.489202 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn" event={"ID":"d5cd74e8-a47b-4246-afe0-2cce1b110f76","Type":"ContainerStarted","Data":"5b8672d151785b1681602e636cc036965e3946b144cd2092a60e2e6dc620f5fa"} Jul 24 14:37:01.548346 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.548321 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-c55zc"] Jul 24 14:37:01.550305 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:37:01.550276 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9546a497_7d33_4318_9842_704564c2126b.slice/crio-1ee43fc269f6ea69835736df24d257a3d55975301d00cc19b53587f77486f96f WatchSource:0}: Error finding container 1ee43fc269f6ea69835736df24d257a3d55975301d00cc19b53587f77486f96f: Status 404 returned error can't find the container with id 1ee43fc269f6ea69835736df24d257a3d55975301d00cc19b53587f77486f96f Jul 24 14:37:01.942629 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.942587 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-j447f"] Jul 24 14:37:01.945139 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.945119 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-j447f" Jul 24 14:37:01.947956 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.947931 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 24 14:37:01.948243 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.948221 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-n7lg6\"" Jul 24 14:37:01.962255 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:01.962186 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-j447f"] Jul 24 14:37:02.093971 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.093885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90c483e5-7333-4667-a97d-824a72f9c9c0-tls-certs\") pod \"model-serving-api-54d89bd5fc-j447f\" (UID: \"90c483e5-7333-4667-a97d-824a72f9c9c0\") " pod="opendatahub/model-serving-api-54d89bd5fc-j447f" Jul 24 14:37:02.093971 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.093945 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spmkn\" (UniqueName: \"kubernetes.io/projected/90c483e5-7333-4667-a97d-824a72f9c9c0-kube-api-access-spmkn\") pod \"model-serving-api-54d89bd5fc-j447f\" (UID: \"90c483e5-7333-4667-a97d-824a72f9c9c0\") " pod="opendatahub/model-serving-api-54d89bd5fc-j447f" Jul 24 14:37:02.194616 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.194511 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90c483e5-7333-4667-a97d-824a72f9c9c0-tls-certs\") pod \"model-serving-api-54d89bd5fc-j447f\" (UID: \"90c483e5-7333-4667-a97d-824a72f9c9c0\") " pod="opendatahub/model-serving-api-54d89bd5fc-j447f" Jul 24 14:37:02.194616 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.194594 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spmkn\" (UniqueName: \"kubernetes.io/projected/90c483e5-7333-4667-a97d-824a72f9c9c0-kube-api-access-spmkn\") pod \"model-serving-api-54d89bd5fc-j447f\" (UID: \"90c483e5-7333-4667-a97d-824a72f9c9c0\") " pod="opendatahub/model-serving-api-54d89bd5fc-j447f" Jul 24 14:37:02.198133 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.198104 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90c483e5-7333-4667-a97d-824a72f9c9c0-tls-certs\") pod \"model-serving-api-54d89bd5fc-j447f\" (UID: \"90c483e5-7333-4667-a97d-824a72f9c9c0\") " pod="opendatahub/model-serving-api-54d89bd5fc-j447f" Jul 24 14:37:02.214873 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.214840 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spmkn\" (UniqueName: \"kubernetes.io/projected/90c483e5-7333-4667-a97d-824a72f9c9c0-kube-api-access-spmkn\") pod \"model-serving-api-54d89bd5fc-j447f\" (UID: \"90c483e5-7333-4667-a97d-824a72f9c9c0\") " pod="opendatahub/model-serving-api-54d89bd5fc-j447f" Jul 24 14:37:02.259739 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.259701 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-j447f" Jul 24 14:37:02.405632 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.405598 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-j447f"] Jul 24 14:37:02.411746 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:37:02.411718 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c483e5_7333_4667_a97d_824a72f9c9c0.slice/crio-79072229c3c5795ab7c073c94dddfd15542704e14457a96f242fc7a3549e0808 WatchSource:0}: Error finding container 79072229c3c5795ab7c073c94dddfd15542704e14457a96f242fc7a3549e0808: Status 404 returned error can't find the container with id 79072229c3c5795ab7c073c94dddfd15542704e14457a96f242fc7a3549e0808 Jul 24 14:37:02.495480 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.495392 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-j447f" event={"ID":"90c483e5-7333-4667-a97d-824a72f9c9c0","Type":"ContainerStarted","Data":"79072229c3c5795ab7c073c94dddfd15542704e14457a96f242fc7a3549e0808"} Jul 24 14:37:02.496808 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.496773 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-c55zc" event={"ID":"9546a497-7d33-4318-9842-704564c2126b","Type":"ContainerStarted","Data":"1ee43fc269f6ea69835736df24d257a3d55975301d00cc19b53587f77486f96f"} Jul 24 14:37:02.689426 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.687959 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg"] Jul 24 14:37:02.690856 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.690819 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.698937 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.698900 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 24 14:37:02.699448 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.699428 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qr4vw\"" Jul 24 14:37:02.699689 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.699665 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 24 14:37:02.699886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.699868 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 24 14:37:02.700066 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.700050 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 24 14:37:02.711399 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.711331 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg"] Jul 24 14:37:02.799354 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.799306 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.799557 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.799371 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.799557 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.799415 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.799557 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.799453 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qztbr\" (UniqueName: \"kubernetes.io/projected/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-kube-api-access-qztbr\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.799557 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.799495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.799557 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.799539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.799808 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.799565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.900850 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.900807 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.901094 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.900880 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.901094 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.900925 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qztbr\" (UniqueName: \"kubernetes.io/projected/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-kube-api-access-qztbr\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.901094 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.900968 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.901094 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.900997 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.901094 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.901021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.901358 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.901124 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.902096 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.902068 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.904706 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.904679 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.907805 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.906218 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.907977 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.907930 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.908180 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.908160 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.914298 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.914267 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qztbr\" (UniqueName: \"kubernetes.io/projected/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-kube-api-access-qztbr\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:02.915776 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:02.915718 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-rgqmg\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:03.003822 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:03.003731 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:03.194698 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:03.194659 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg"] Jul 24 14:37:03.202060 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:37:03.202003 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a7d98e9_ec8e_4376_b8ce_c4af4236f38a.slice/crio-a3d6ae62a97d3de80713bb9d166c97fd9414d585193234f4f7ebd2cbacd7f2a7 WatchSource:0}: Error finding container a3d6ae62a97d3de80713bb9d166c97fd9414d585193234f4f7ebd2cbacd7f2a7: Status 404 returned error can't find the container with id a3d6ae62a97d3de80713bb9d166c97fd9414d585193234f4f7ebd2cbacd7f2a7 Jul 24 14:37:03.506691 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:03.506508 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" event={"ID":"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a","Type":"ContainerStarted","Data":"a3d6ae62a97d3de80713bb9d166c97fd9414d585193234f4f7ebd2cbacd7f2a7"} Jul 24 14:37:06.885470 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:06.885431 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:37:06.885825 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:06.885519 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:37:07.528940 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:07.528899 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn" event={"ID":"d5cd74e8-a47b-4246-afe0-2cce1b110f76","Type":"ContainerStarted","Data":"7587044c929b0a9bf8d9f61594379209f5de17fa4242ec5b698c6e842b971a0e"} Jul 24 14:37:07.530416 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:07.530387 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-c55zc" event={"ID":"9546a497-7d33-4318-9842-704564c2126b","Type":"ContainerStarted","Data":"b360bda15427c1f15eefbdef66182a44b6e0a681a52ee5c2a6477302282fb043"} Jul 24 14:37:07.530581 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:07.530457 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-c55zc" Jul 24 14:37:07.531948 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:07.531926 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" event={"ID":"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a","Type":"ContainerStarted","Data":"f8d0c4ce62ec169071db37570dd8755d9b579c6e1524b41eea78a0b1b7b542e6"} Jul 24 14:37:07.532078 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:07.532054 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:07.533389 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:07.533366 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-j447f" event={"ID":"90c483e5-7333-4667-a97d-824a72f9c9c0","Type":"ContainerStarted","Data":"d0f8e1c0555d21e579308eccdc5c0bf8b0e15d6432038bbc5fbab0f765a2f9d0"} Jul 24 14:37:07.533515 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:07.533501 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-j447f" Jul 24 14:37:07.534148 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:07.534129 2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-rgqmg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 14:37:07.534217 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:07.534164 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" podUID="7a7d98e9-ec8e-4376-b8ce-c4af4236f38a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 14:37:07.546975 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:07.546919 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55ffdfd896-vb7sn" podStartSLOduration=2.960822059 podStartE2EDuration="7.546903774s" totalImagesPullingTime="4.586081715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:07.545667873 +0000 UTC m=+323.102583765" watchObservedRunningTime="2026-07-24 14:37:07.546903774 +0000 UTC m=+323.103819666" Jul 24 14:37:07.568508 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:07.568443 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" podStartSLOduration=1.887731253 podStartE2EDuration="5.568422283s" totalImagesPullingTime="3.68069103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:07.567732435 +0000 UTC m=+323.124648330" watchObservedRunningTime="2026-07-24 14:37:07.568422283 +0000 UTC m=+323.125338177" Jul 24 14:37:07.586667 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:07.586614 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-j447f" podStartSLOduration=3.073089168 podStartE2EDuration="6.586601799s" totalImagesPullingTime="3.513512631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:07.585354169 +0000 UTC m=+323.142270073" watchObservedRunningTime="2026-07-24 14:37:07.586601799 +0000 UTC m=+323.143517682" Jul 24 14:37:07.605942 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:07.605896 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-c55zc" podStartSLOduration=1.342822557 podStartE2EDuration="6.605876789s" totalImagesPullingTime="5.263054232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:07.603229648 +0000 UTC m=+323.160145553" watchObservedRunningTime="2026-07-24 14:37:07.605876789 +0000 UTC m=+323.162792682" Jul 24 14:37:08.538785 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:08.538748 2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-rgqmg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 14:37:08.539153 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:08.538808 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" podUID="7a7d98e9-ec8e-4376-b8ce-c4af4236f38a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 14:37:08.896547 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:08.896446 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj"] Jul 24 14:37:08.899875 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:08.899857 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:08.905276 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:08.905250 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gz5z4\"" Jul 24 14:37:08.928879 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:08.928846 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj"] Jul 24 14:37:09.066879 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.066835 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.067093 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.066908 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ljrn\" (UniqueName: \"kubernetes.io/projected/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-kube-api-access-9ljrn\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.067093 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.066945 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.067093 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.066977 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.067093 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.067003 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.067093 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.067082 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.067342 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.067111 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.067342 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.067193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.067342 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.067229 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.168486 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.168401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ljrn\" (UniqueName: \"kubernetes.io/projected/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-kube-api-access-9ljrn\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.168486 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.168444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.168701 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.168487 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.168701 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.168503 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.168701 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.168551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.168701 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.168580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.168701 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.168601 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.168701 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.168620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.168701 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.168677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.169041 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.168948 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.169041 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.168974 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.169178 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.169149 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.169241 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.169180 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.169409 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.169389 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.171124 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.171099 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.171268 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.171247 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.183168 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.183141 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ljrn\" (UniqueName: \"kubernetes.io/projected/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-kube-api-access-9ljrn\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.186238 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.186212 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e3ad153-d7a0-4741-9130-f5c7fe1a8b43-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj\" (UID: \"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.210184 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.210150 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:09.351196 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.351172 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj"] Jul 24 14:37:09.353188 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:37:09.353163 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e3ad153_d7a0_4741_9130_f5c7fe1a8b43.slice/crio-3a90563528ab8ab40d1d7d25fcaa87260e447eb9d51ea869c2d459fef38578b2 WatchSource:0}: Error finding container 3a90563528ab8ab40d1d7d25fcaa87260e447eb9d51ea869c2d459fef38578b2: Status 404 returned error can't find the container with id 3a90563528ab8ab40d1d7d25fcaa87260e447eb9d51ea869c2d459fef38578b2 Jul 24 14:37:09.545518 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:09.545482 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" event={"ID":"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43","Type":"ContainerStarted","Data":"3a90563528ab8ab40d1d7d25fcaa87260e447eb9d51ea869c2d459fef38578b2"} Jul 24 14:37:11.539666 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:11.539635 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:12.128081 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:12.128050 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:37:12.128164 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:12.128121 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:37:12.128164 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:12.128148 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:37:12.565345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:12.565305 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" event={"ID":"8e3ad153-d7a0-4741-9130-f5c7fe1a8b43","Type":"ContainerStarted","Data":"b9277d7c653b2b588db11ea204409a2e2a58df8d6b0e626402b65e2b8f672848"} Jul 24 14:37:12.579572 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:12.579515 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg"] Jul 24 14:37:12.579755 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:12.579733 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" podUID="7a7d98e9-ec8e-4376-b8ce-c4af4236f38a" containerName="discovery" containerID="cri-o://f8d0c4ce62ec169071db37570dd8755d9b579c6e1524b41eea78a0b1b7b542e6" gracePeriod=30 Jul 24 14:37:12.643833 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:12.643781 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" podStartSLOduration=1.8711617170000001 podStartE2EDuration="4.643762566s" totalImagesPullingTime="2.772600849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:12.641623303 +0000 UTC m=+328.198539195" watchObservedRunningTime="2026-07-24 14:37:12.643762566 +0000 UTC m=+328.200678457" Jul 24 14:37:12.836113 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:12.836084 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:13.010818 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.010784 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-csr-dns-cert\") pod \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " Jul 24 14:37:13.010818 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.010816 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-kubeconfig\") pod \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " Jul 24 14:37:13.011055 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.010869 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-local-certs\") pod \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " Jul 24 14:37:13.011055 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.010921 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qztbr\" (UniqueName: \"kubernetes.io/projected/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-kube-api-access-qztbr\") pod \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " Jul 24 14:37:13.011055 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.010968 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-token\") pod \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " Jul 24 14:37:13.011055 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.010996 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-cacerts\") pod \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " Jul 24 14:37:13.011055 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.011023 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-csr-ca-configmap\") pod \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\" (UID: \"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a\") " Jul 24 14:37:13.011783 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.011751 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "7a7d98e9-ec8e-4376-b8ce-c4af4236f38a" (UID: "7a7d98e9-ec8e-4376-b8ce-c4af4236f38a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:37:13.013645 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.013596 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "7a7d98e9-ec8e-4376-b8ce-c4af4236f38a" (UID: "7a7d98e9-ec8e-4376-b8ce-c4af4236f38a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:37:13.013763 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.013650 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-local-certs" (OuterVolumeSpecName: "local-certs") pod "7a7d98e9-ec8e-4376-b8ce-c4af4236f38a" (UID: "7a7d98e9-ec8e-4376-b8ce-c4af4236f38a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:37:13.013763 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.013689 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "7a7d98e9-ec8e-4376-b8ce-c4af4236f38a" (UID: "7a7d98e9-ec8e-4376-b8ce-c4af4236f38a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:37:13.013859 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.013772 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-kube-api-access-qztbr" (OuterVolumeSpecName: "kube-api-access-qztbr") pod "7a7d98e9-ec8e-4376-b8ce-c4af4236f38a" (UID: "7a7d98e9-ec8e-4376-b8ce-c4af4236f38a"). InnerVolumeSpecName "kube-api-access-qztbr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:37:13.013892 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.013859 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a7d98e9-ec8e-4376-b8ce-c4af4236f38a" (UID: "7a7d98e9-ec8e-4376-b8ce-c4af4236f38a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:37:13.014000 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.013983 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-cacerts" (OuterVolumeSpecName: "cacerts") pod "7a7d98e9-ec8e-4376-b8ce-c4af4236f38a" (UID: "7a7d98e9-ec8e-4376-b8ce-c4af4236f38a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:37:13.112109 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.112005 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qztbr\" (UniqueName: \"kubernetes.io/projected/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-kube-api-access-qztbr\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:37:13.112109 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.112044 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-token\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:37:13.112109 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.112058 2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-cacerts\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:37:13.112109 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.112068 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-csr-ca-configmap\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:37:13.112109 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.112079 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-csr-dns-cert\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:37:13.112109 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.112090 2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-istio-kubeconfig\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:37:13.112109 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.112102 2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a-local-certs\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:37:13.211198 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.211168 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:13.216176 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.216149 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:13.571825 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.571786 2581 generic.go:356] "Generic (PLEG): container finished" podID="7a7d98e9-ec8e-4376-b8ce-c4af4236f38a" containerID="f8d0c4ce62ec169071db37570dd8755d9b579c6e1524b41eea78a0b1b7b542e6" exitCode=0 Jul 24 14:37:13.572346 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.571839 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" Jul 24 14:37:13.572346 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.571882 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" event={"ID":"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a","Type":"ContainerDied","Data":"f8d0c4ce62ec169071db37570dd8755d9b579c6e1524b41eea78a0b1b7b542e6"} Jul 24 14:37:13.572346 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.571949 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg" event={"ID":"7a7d98e9-ec8e-4376-b8ce-c4af4236f38a","Type":"ContainerDied","Data":"a3d6ae62a97d3de80713bb9d166c97fd9414d585193234f4f7ebd2cbacd7f2a7"} Jul 24 14:37:13.572346 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.571983 2581 scope.go:117] "RemoveContainer" containerID="f8d0c4ce62ec169071db37570dd8755d9b579c6e1524b41eea78a0b1b7b542e6" Jul 24 14:37:13.572570 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.572360 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:13.573478 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.573457 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj" Jul 24 14:37:13.582033 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.582015 2581 scope.go:117] "RemoveContainer" containerID="f8d0c4ce62ec169071db37570dd8755d9b579c6e1524b41eea78a0b1b7b542e6" Jul 24 14:37:13.582315 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:37:13.582291 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8d0c4ce62ec169071db37570dd8755d9b579c6e1524b41eea78a0b1b7b542e6\": container with ID starting with f8d0c4ce62ec169071db37570dd8755d9b579c6e1524b41eea78a0b1b7b542e6 not found: ID does not exist" containerID="f8d0c4ce62ec169071db37570dd8755d9b579c6e1524b41eea78a0b1b7b542e6" Jul 24 14:37:13.582357 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.582326 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8d0c4ce62ec169071db37570dd8755d9b579c6e1524b41eea78a0b1b7b542e6"} err="failed to get container status \"f8d0c4ce62ec169071db37570dd8755d9b579c6e1524b41eea78a0b1b7b542e6\": rpc error: code = NotFound desc = could not find container \"f8d0c4ce62ec169071db37570dd8755d9b579c6e1524b41eea78a0b1b7b542e6\": container with ID starting with f8d0c4ce62ec169071db37570dd8755d9b579c6e1524b41eea78a0b1b7b542e6 not found: ID does not exist" Jul 24 14:37:13.625689 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.625652 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg"] Jul 24 14:37:13.627384 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:13.627361 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rgqmg"] Jul 24 14:37:14.971243 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:14.971205 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a7d98e9-ec8e-4376-b8ce-c4af4236f38a" path="/var/lib/kubelet/pods/7a7d98e9-ec8e-4376-b8ce-c4af4236f38a/volumes" Jul 24 14:37:18.540305 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:18.540272 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-c55zc" Jul 24 14:37:18.542449 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:18.542428 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-j447f" Jul 24 14:37:59.113850 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.113814 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtt9q"] Jul 24 14:37:59.114249 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.114136 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a7d98e9-ec8e-4376-b8ce-c4af4236f38a" containerName="discovery" Jul 24 14:37:59.114249 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.114147 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a7d98e9-ec8e-4376-b8ce-c4af4236f38a" containerName="discovery" Jul 24 14:37:59.114249 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.114198 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a7d98e9-ec8e-4376-b8ce-c4af4236f38a" containerName="discovery" Jul 24 14:37:59.117260 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.117241 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dtt9q" Jul 24 14:37:59.121599 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.121573 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 14:37:59.121841 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.121816 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 14:37:59.121951 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.121826 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-cxcj9\"" Jul 24 14:37:59.137501 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.137470 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtt9q"] Jul 24 14:37:59.186722 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.186689 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smnqp\" (UniqueName: \"kubernetes.io/projected/b6c67364-5951-411a-89d1-2874ef04630b-kube-api-access-smnqp\") pod \"kuadrant-operator-catalog-dtt9q\" (UID: \"b6c67364-5951-411a-89d1-2874ef04630b\") " pod="kuadrant-system/kuadrant-operator-catalog-dtt9q" Jul 24 14:37:59.287810 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.287772 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smnqp\" (UniqueName: \"kubernetes.io/projected/b6c67364-5951-411a-89d1-2874ef04630b-kube-api-access-smnqp\") pod \"kuadrant-operator-catalog-dtt9q\" (UID: \"b6c67364-5951-411a-89d1-2874ef04630b\") " pod="kuadrant-system/kuadrant-operator-catalog-dtt9q" Jul 24 14:37:59.300562 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.300503 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smnqp\" (UniqueName: \"kubernetes.io/projected/b6c67364-5951-411a-89d1-2874ef04630b-kube-api-access-smnqp\") pod \"kuadrant-operator-catalog-dtt9q\" (UID: \"b6c67364-5951-411a-89d1-2874ef04630b\") " pod="kuadrant-system/kuadrant-operator-catalog-dtt9q" Jul 24 14:37:59.389355 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.389271 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtt9q"] Jul 24 14:37:59.389510 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.389495 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dtt9q" Jul 24 14:37:59.536209 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.536179 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtt9q"] Jul 24 14:37:59.604281 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.604248 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-974jx"] Jul 24 14:37:59.607507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.607486 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-974jx" Jul 24 14:37:59.618418 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.618388 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-974jx"] Jul 24 14:37:59.692164 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.692076 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpw8r\" (UniqueName: \"kubernetes.io/projected/2f62de5a-b60c-4dc0-9772-7e13fd62ef02-kube-api-access-rpw8r\") pod \"kuadrant-operator-catalog-974jx\" (UID: \"2f62de5a-b60c-4dc0-9772-7e13fd62ef02\") " pod="kuadrant-system/kuadrant-operator-catalog-974jx" Jul 24 14:37:59.781022 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.780986 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dtt9q" event={"ID":"b6c67364-5951-411a-89d1-2874ef04630b","Type":"ContainerStarted","Data":"9c98dd992a89270858d83cd204acf839d66bfb58107fb03bb775389d7223702b"} Jul 24 14:37:59.792659 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.792622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpw8r\" (UniqueName: \"kubernetes.io/projected/2f62de5a-b60c-4dc0-9772-7e13fd62ef02-kube-api-access-rpw8r\") pod \"kuadrant-operator-catalog-974jx\" (UID: \"2f62de5a-b60c-4dc0-9772-7e13fd62ef02\") " pod="kuadrant-system/kuadrant-operator-catalog-974jx" Jul 24 14:37:59.803895 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.803866 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpw8r\" (UniqueName: \"kubernetes.io/projected/2f62de5a-b60c-4dc0-9772-7e13fd62ef02-kube-api-access-rpw8r\") pod \"kuadrant-operator-catalog-974jx\" (UID: \"2f62de5a-b60c-4dc0-9772-7e13fd62ef02\") " pod="kuadrant-system/kuadrant-operator-catalog-974jx" Jul 24 14:37:59.917235 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:37:59.917191 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-974jx" Jul 24 14:38:00.057239 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:00.057164 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-974jx"] Jul 24 14:38:00.059381 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:38:00.059352 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f62de5a_b60c_4dc0_9772_7e13fd62ef02.slice/crio-7d66c6c17be3f59ea57b9b032aaf0ce134fb5246ab194c199aeb4370d364f9b7 WatchSource:0}: Error finding container 7d66c6c17be3f59ea57b9b032aaf0ce134fb5246ab194c199aeb4370d364f9b7: Status 404 returned error can't find the container with id 7d66c6c17be3f59ea57b9b032aaf0ce134fb5246ab194c199aeb4370d364f9b7 Jul 24 14:38:00.787227 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:00.787175 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-974jx" event={"ID":"2f62de5a-b60c-4dc0-9772-7e13fd62ef02","Type":"ContainerStarted","Data":"7d66c6c17be3f59ea57b9b032aaf0ce134fb5246ab194c199aeb4370d364f9b7"} Jul 24 14:38:01.794509 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:01.794464 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-974jx" event={"ID":"2f62de5a-b60c-4dc0-9772-7e13fd62ef02","Type":"ContainerStarted","Data":"f71cef3b7b2763f5eb597731ef9d56bf64b27db853b64e4dd4281166e44fd812"} Jul 24 14:38:01.796256 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:01.796222 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dtt9q" event={"ID":"b6c67364-5951-411a-89d1-2874ef04630b","Type":"ContainerStarted","Data":"9c245e3ba7fcf7bbee99561a9da73b5e300dfb0f23723cfae025377b7e85dd84"} Jul 24 14:38:01.796445 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:01.796269 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-dtt9q" podUID="b6c67364-5951-411a-89d1-2874ef04630b" containerName="registry-server" containerID="cri-o://9c245e3ba7fcf7bbee99561a9da73b5e300dfb0f23723cfae025377b7e85dd84" gracePeriod=2 Jul 24 14:38:01.813363 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:01.813303 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-974jx" podStartSLOduration=1.213490516 podStartE2EDuration="2.813286405s" totalImagesPullingTime="1.599795889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:38:01.81157858 +0000 UTC m=+377.368494473" watchObservedRunningTime="2026-07-24 14:38:01.813286405 +0000 UTC m=+377.370202297" Jul 24 14:38:01.828886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:01.828821 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dtt9q" podStartSLOduration=0.700024176 podStartE2EDuration="2.828799769s" totalImagesPullingTime="2.128775593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:38:01.828021507 +0000 UTC m=+377.384937399" watchObservedRunningTime="2026-07-24 14:38:01.828799769 +0000 UTC m=+377.385715662" Jul 24 14:38:02.046757 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:02.046731 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dtt9q" Jul 24 14:38:02.217935 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:02.217844 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smnqp\" (UniqueName: \"kubernetes.io/projected/b6c67364-5951-411a-89d1-2874ef04630b-kube-api-access-smnqp\") pod \"b6c67364-5951-411a-89d1-2874ef04630b\" (UID: \"b6c67364-5951-411a-89d1-2874ef04630b\") " Jul 24 14:38:02.220029 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:02.220003 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6c67364-5951-411a-89d1-2874ef04630b-kube-api-access-smnqp" (OuterVolumeSpecName: "kube-api-access-smnqp") pod "b6c67364-5951-411a-89d1-2874ef04630b" (UID: "b6c67364-5951-411a-89d1-2874ef04630b"). InnerVolumeSpecName "kube-api-access-smnqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:38:02.319057 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:02.319020 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smnqp\" (UniqueName: \"kubernetes.io/projected/b6c67364-5951-411a-89d1-2874ef04630b-kube-api-access-smnqp\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:38:02.801414 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:02.801379 2581 generic.go:356] "Generic (PLEG): container finished" podID="b6c67364-5951-411a-89d1-2874ef04630b" containerID="9c245e3ba7fcf7bbee99561a9da73b5e300dfb0f23723cfae025377b7e85dd84" exitCode=0 Jul 24 14:38:02.801909 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:02.801426 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dtt9q" Jul 24 14:38:02.801909 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:02.801469 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dtt9q" event={"ID":"b6c67364-5951-411a-89d1-2874ef04630b","Type":"ContainerDied","Data":"9c245e3ba7fcf7bbee99561a9da73b5e300dfb0f23723cfae025377b7e85dd84"} Jul 24 14:38:02.801909 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:02.801523 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dtt9q" event={"ID":"b6c67364-5951-411a-89d1-2874ef04630b","Type":"ContainerDied","Data":"9c98dd992a89270858d83cd204acf839d66bfb58107fb03bb775389d7223702b"} Jul 24 14:38:02.801909 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:02.801553 2581 scope.go:117] "RemoveContainer" containerID="9c245e3ba7fcf7bbee99561a9da73b5e300dfb0f23723cfae025377b7e85dd84" Jul 24 14:38:02.813360 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:02.813332 2581 scope.go:117] "RemoveContainer" containerID="9c245e3ba7fcf7bbee99561a9da73b5e300dfb0f23723cfae025377b7e85dd84" Jul 24 14:38:02.813692 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:38:02.813671 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c245e3ba7fcf7bbee99561a9da73b5e300dfb0f23723cfae025377b7e85dd84\": container with ID starting with 9c245e3ba7fcf7bbee99561a9da73b5e300dfb0f23723cfae025377b7e85dd84 not found: ID does not exist" containerID="9c245e3ba7fcf7bbee99561a9da73b5e300dfb0f23723cfae025377b7e85dd84" Jul 24 14:38:02.813774 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:02.813704 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c245e3ba7fcf7bbee99561a9da73b5e300dfb0f23723cfae025377b7e85dd84"} err="failed to get container status \"9c245e3ba7fcf7bbee99561a9da73b5e300dfb0f23723cfae025377b7e85dd84\": rpc error: code = NotFound desc = could not find container \"9c245e3ba7fcf7bbee99561a9da73b5e300dfb0f23723cfae025377b7e85dd84\": container with ID starting with 9c245e3ba7fcf7bbee99561a9da73b5e300dfb0f23723cfae025377b7e85dd84 not found: ID does not exist" Jul 24 14:38:02.828150 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:02.828123 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtt9q"] Jul 24 14:38:02.836057 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:02.836032 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtt9q"] Jul 24 14:38:02.971845 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:02.971769 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6c67364-5951-411a-89d1-2874ef04630b" path="/var/lib/kubelet/pods/b6c67364-5951-411a-89d1-2874ef04630b/volumes" Jul 24 14:38:09.917543 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:09.917466 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-974jx" Jul 24 14:38:09.917978 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:09.917563 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-974jx" Jul 24 14:38:09.938967 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:09.938941 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-974jx" Jul 24 14:38:10.861946 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:10.861917 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-974jx" Jul 24 14:38:31.089204 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:31.089168 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv"] Jul 24 14:38:31.089655 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:31.089508 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6c67364-5951-411a-89d1-2874ef04630b" containerName="registry-server" Jul 24 14:38:31.089655 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:31.089519 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6c67364-5951-411a-89d1-2874ef04630b" containerName="registry-server" Jul 24 14:38:31.089655 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:31.089586 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6c67364-5951-411a-89d1-2874ef04630b" containerName="registry-server" Jul 24 14:38:31.093235 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:31.093217 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:38:31.096182 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:31.096163 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jdw62\"" Jul 24 14:38:31.107807 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:31.107785 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv"] Jul 24 14:38:31.168343 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:31.168308 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5lcj\" (UniqueName: \"kubernetes.io/projected/9fe8be2f-2698-4536-a055-7668d29921ab-kube-api-access-s5lcj\") pod \"limitador-operator-controller-manager-859d7b78bd-q6wqv\" (UID: \"9fe8be2f-2698-4536-a055-7668d29921ab\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:38:31.268934 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:31.268899 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5lcj\" (UniqueName: \"kubernetes.io/projected/9fe8be2f-2698-4536-a055-7668d29921ab-kube-api-access-s5lcj\") pod \"limitador-operator-controller-manager-859d7b78bd-q6wqv\" (UID: \"9fe8be2f-2698-4536-a055-7668d29921ab\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:38:31.281557 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:31.281494 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5lcj\" (UniqueName: \"kubernetes.io/projected/9fe8be2f-2698-4536-a055-7668d29921ab-kube-api-access-s5lcj\") pod \"limitador-operator-controller-manager-859d7b78bd-q6wqv\" (UID: \"9fe8be2f-2698-4536-a055-7668d29921ab\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:38:31.403048 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:31.402933 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:38:31.536075 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:31.536046 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv"] Jul 24 14:38:31.538474 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:38:31.538447 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fe8be2f_2698_4536_a055_7668d29921ab.slice/crio-bd3c6b641de298a2c461809db67485ab2e845462bc845587e05e062cef1a0348 WatchSource:0}: Error finding container bd3c6b641de298a2c461809db67485ab2e845462bc845587e05e062cef1a0348: Status 404 returned error can't find the container with id bd3c6b641de298a2c461809db67485ab2e845462bc845587e05e062cef1a0348 Jul 24 14:38:31.942813 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:31.942781 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" event={"ID":"9fe8be2f-2698-4536-a055-7668d29921ab","Type":"ContainerStarted","Data":"bd3c6b641de298a2c461809db67485ab2e845462bc845587e05e062cef1a0348"} Jul 24 14:38:33.953828 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:33.953786 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" event={"ID":"9fe8be2f-2698-4536-a055-7668d29921ab","Type":"ContainerStarted","Data":"37c961f3cd3cfb394f616187dd37605d6a707ee95451c5d0b74f0dd0a02bf74f"} Jul 24 14:38:33.954283 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:33.953934 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:38:33.972089 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:33.972042 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" podStartSLOduration=1.4297377 podStartE2EDuration="2.972026805s" totalImagesPullingTime="1.542289105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:38:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:38:33.970628919 +0000 UTC m=+409.527544810" watchObservedRunningTime="2026-07-24 14:38:33.972026805 +0000 UTC m=+409.528942697" Jul 24 14:38:36.172764 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:36.172720 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2"] Jul 24 14:38:36.175715 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:36.175694 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:38:36.179785 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:36.179766 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vqfmz\"" Jul 24 14:38:36.192859 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:36.192835 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2"] Jul 24 14:38:36.313364 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:36.313331 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d4f70f5-4b4e-4b18-bdf6-0ab159afede4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w45c2\" (UID: \"9d4f70f5-4b4e-4b18-bdf6-0ab159afede4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:38:36.313557 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:36.313394 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwm4s\" (UniqueName: \"kubernetes.io/projected/9d4f70f5-4b4e-4b18-bdf6-0ab159afede4-kube-api-access-qwm4s\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w45c2\" (UID: \"9d4f70f5-4b4e-4b18-bdf6-0ab159afede4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:38:36.414343 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:36.414304 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwm4s\" (UniqueName: \"kubernetes.io/projected/9d4f70f5-4b4e-4b18-bdf6-0ab159afede4-kube-api-access-qwm4s\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w45c2\" (UID: \"9d4f70f5-4b4e-4b18-bdf6-0ab159afede4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:38:36.414522 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:36.414370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d4f70f5-4b4e-4b18-bdf6-0ab159afede4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w45c2\" (UID: \"9d4f70f5-4b4e-4b18-bdf6-0ab159afede4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:38:36.414756 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:36.414738 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d4f70f5-4b4e-4b18-bdf6-0ab159afede4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w45c2\" (UID: \"9d4f70f5-4b4e-4b18-bdf6-0ab159afede4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:38:36.423255 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:36.423188 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwm4s\" (UniqueName: \"kubernetes.io/projected/9d4f70f5-4b4e-4b18-bdf6-0ab159afede4-kube-api-access-qwm4s\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w45c2\" (UID: \"9d4f70f5-4b4e-4b18-bdf6-0ab159afede4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:38:36.486228 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:36.486177 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:38:36.620578 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:36.620549 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2"] Jul 24 14:38:36.623766 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:38:36.623732 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d4f70f5_4b4e_4b18_bdf6_0ab159afede4.slice/crio-484632fc0c2b2367ced3f8d9f168040f01c089edcca6696ed10c9eb59feb5286 WatchSource:0}: Error finding container 484632fc0c2b2367ced3f8d9f168040f01c089edcca6696ed10c9eb59feb5286: Status 404 returned error can't find the container with id 484632fc0c2b2367ced3f8d9f168040f01c089edcca6696ed10c9eb59feb5286 Jul 24 14:38:36.971961 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:36.971927 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" event={"ID":"9d4f70f5-4b4e-4b18-bdf6-0ab159afede4","Type":"ContainerStarted","Data":"484632fc0c2b2367ced3f8d9f168040f01c089edcca6696ed10c9eb59feb5286"} Jul 24 14:38:39.066141 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:39.066109 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tt62v"] Jul 24 14:38:39.069375 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:39.069358 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tt62v" Jul 24 14:38:39.072471 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:39.072443 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-k65jd\"" Jul 24 14:38:39.072808 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:39.072788 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 24 14:38:39.097462 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:39.097429 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tt62v"] Jul 24 14:38:39.143410 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:39.143378 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vrf6\" (UniqueName: \"kubernetes.io/projected/11d132c6-c031-47d8-9ce7-caecc3b0ed48-kube-api-access-9vrf6\") pod \"dns-operator-controller-manager-864dd78c4c-tt62v\" (UID: \"11d132c6-c031-47d8-9ce7-caecc3b0ed48\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tt62v" Jul 24 14:38:39.244298 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:39.244262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vrf6\" (UniqueName: \"kubernetes.io/projected/11d132c6-c031-47d8-9ce7-caecc3b0ed48-kube-api-access-9vrf6\") pod \"dns-operator-controller-manager-864dd78c4c-tt62v\" (UID: \"11d132c6-c031-47d8-9ce7-caecc3b0ed48\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tt62v" Jul 24 14:38:39.261788 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:39.261753 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vrf6\" (UniqueName: \"kubernetes.io/projected/11d132c6-c031-47d8-9ce7-caecc3b0ed48-kube-api-access-9vrf6\") pod \"dns-operator-controller-manager-864dd78c4c-tt62v\" (UID: \"11d132c6-c031-47d8-9ce7-caecc3b0ed48\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tt62v" Jul 24 14:38:39.380957 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:39.380875 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tt62v" Jul 24 14:38:39.565598 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:39.565568 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tt62v"] Jul 24 14:38:39.568301 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:38:39.568270 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d132c6_c031_47d8_9ce7_caecc3b0ed48.slice/crio-d9556c0aed91dd27a4988ffbd0a6501326da226fb5b4885b9cba39c3005de7cc WatchSource:0}: Error finding container d9556c0aed91dd27a4988ffbd0a6501326da226fb5b4885b9cba39c3005de7cc: Status 404 returned error can't find the container with id d9556c0aed91dd27a4988ffbd0a6501326da226fb5b4885b9cba39c3005de7cc Jul 24 14:38:39.986699 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:39.986661 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tt62v" event={"ID":"11d132c6-c031-47d8-9ce7-caecc3b0ed48","Type":"ContainerStarted","Data":"d9556c0aed91dd27a4988ffbd0a6501326da226fb5b4885b9cba39c3005de7cc"} Jul 24 14:38:42.972305 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:42.972274 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-clq57"] Jul 24 14:38:42.975729 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:42.975711 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-clq57" Jul 24 14:38:42.978239 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:42.978218 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wd5nw\"" Jul 24 14:38:42.986749 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:42.986722 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-clq57"] Jul 24 14:38:43.003471 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:43.003440 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" event={"ID":"9d4f70f5-4b4e-4b18-bdf6-0ab159afede4","Type":"ContainerStarted","Data":"8c50d897f540bc1ff665f122ca2d556703819b3c2052d3209827d5e4077bf422"} Jul 24 14:38:43.003638 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:43.003500 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:38:43.005023 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:43.005000 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tt62v" event={"ID":"11d132c6-c031-47d8-9ce7-caecc3b0ed48","Type":"ContainerStarted","Data":"d80b2cac124237380728e34d4df147f4b8322c0dfa19456fab72ffe6e2832f31"} Jul 24 14:38:43.005129 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:43.005066 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tt62v" Jul 24 14:38:43.029710 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:43.029663 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" podStartSLOduration=1.3007009090000001 podStartE2EDuration="7.029647198s" totalImagesPullingTime="5.728946289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:38:43.026814048 +0000 UTC m=+418.583729964" watchObservedRunningTime="2026-07-24 14:38:43.029647198 +0000 UTC m=+418.586563091" Jul 24 14:38:43.056919 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:43.056866 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tt62v" podStartSLOduration=1.221646834 podStartE2EDuration="4.056849997s" totalImagesPullingTime="2.835203163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:38:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:38:43.045822698 +0000 UTC m=+418.602738590" watchObservedRunningTime="2026-07-24 14:38:43.056849997 +0000 UTC m=+418.613765889" Jul 24 14:38:43.085883 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:43.085848 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjpnd\" (UniqueName: \"kubernetes.io/projected/7c6fae62-81a5-4558-9b8a-a661c9efab08-kube-api-access-gjpnd\") pod \"authorino-operator-75cc8d5cb7-clq57\" (UID: \"7c6fae62-81a5-4558-9b8a-a661c9efab08\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-clq57" Jul 24 14:38:43.187444 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:43.187398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjpnd\" (UniqueName: \"kubernetes.io/projected/7c6fae62-81a5-4558-9b8a-a661c9efab08-kube-api-access-gjpnd\") pod \"authorino-operator-75cc8d5cb7-clq57\" (UID: \"7c6fae62-81a5-4558-9b8a-a661c9efab08\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-clq57" Jul 24 14:38:43.202389 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:43.202357 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjpnd\" (UniqueName: \"kubernetes.io/projected/7c6fae62-81a5-4558-9b8a-a661c9efab08-kube-api-access-gjpnd\") pod \"authorino-operator-75cc8d5cb7-clq57\" (UID: \"7c6fae62-81a5-4558-9b8a-a661c9efab08\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-clq57" Jul 24 14:38:43.286435 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:43.286397 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-clq57" Jul 24 14:38:43.427467 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:43.427443 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-clq57"] Jul 24 14:38:43.429257 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:38:43.429224 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6fae62_81a5_4558_9b8a_a661c9efab08.slice/crio-f6d161374f2f8e3aa01299c9033567edb92c6043d716fa0bac3bb384b70a1c0a WatchSource:0}: Error finding container f6d161374f2f8e3aa01299c9033567edb92c6043d716fa0bac3bb384b70a1c0a: Status 404 returned error can't find the container with id f6d161374f2f8e3aa01299c9033567edb92c6043d716fa0bac3bb384b70a1c0a Jul 24 14:38:44.010714 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:44.010664 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-clq57" event={"ID":"7c6fae62-81a5-4558-9b8a-a661c9efab08","Type":"ContainerStarted","Data":"f6d161374f2f8e3aa01299c9033567edb92c6043d716fa0bac3bb384b70a1c0a"} Jul 24 14:38:44.961411 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:44.961380 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:38:45.336928 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.336895 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv"] Jul 24 14:38:45.349401 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.349367 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv" Jul 24 14:38:45.352986 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.352469 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dgd8w\"" Jul 24 14:38:45.352986 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.352821 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 24 14:38:45.353228 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.353202 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 24 14:38:45.354175 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.354126 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv"] Jul 24 14:38:45.511088 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.511050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnj2q\" (UniqueName: \"kubernetes.io/projected/04d6fc32-2907-4685-ad95-94d1bcb28b8d-kube-api-access-hnj2q\") pod \"kuadrant-console-plugin-66b5774985-fd4dv\" (UID: \"04d6fc32-2907-4685-ad95-94d1bcb28b8d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv" Jul 24 14:38:45.511293 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.511116 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/04d6fc32-2907-4685-ad95-94d1bcb28b8d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fd4dv\" (UID: \"04d6fc32-2907-4685-ad95-94d1bcb28b8d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv" Jul 24 14:38:45.511293 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.511153 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/04d6fc32-2907-4685-ad95-94d1bcb28b8d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fd4dv\" (UID: \"04d6fc32-2907-4685-ad95-94d1bcb28b8d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv" Jul 24 14:38:45.612230 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.612148 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnj2q\" (UniqueName: \"kubernetes.io/projected/04d6fc32-2907-4685-ad95-94d1bcb28b8d-kube-api-access-hnj2q\") pod \"kuadrant-console-plugin-66b5774985-fd4dv\" (UID: \"04d6fc32-2907-4685-ad95-94d1bcb28b8d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv" Jul 24 14:38:45.612230 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.612218 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/04d6fc32-2907-4685-ad95-94d1bcb28b8d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fd4dv\" (UID: \"04d6fc32-2907-4685-ad95-94d1bcb28b8d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv" Jul 24 14:38:45.612456 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.612261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/04d6fc32-2907-4685-ad95-94d1bcb28b8d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fd4dv\" (UID: \"04d6fc32-2907-4685-ad95-94d1bcb28b8d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv" Jul 24 14:38:45.613014 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.612989 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/04d6fc32-2907-4685-ad95-94d1bcb28b8d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fd4dv\" (UID: \"04d6fc32-2907-4685-ad95-94d1bcb28b8d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv" Jul 24 14:38:45.615152 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.615124 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/04d6fc32-2907-4685-ad95-94d1bcb28b8d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fd4dv\" (UID: \"04d6fc32-2907-4685-ad95-94d1bcb28b8d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv" Jul 24 14:38:45.639223 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.639190 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnj2q\" (UniqueName: \"kubernetes.io/projected/04d6fc32-2907-4685-ad95-94d1bcb28b8d-kube-api-access-hnj2q\") pod \"kuadrant-console-plugin-66b5774985-fd4dv\" (UID: \"04d6fc32-2907-4685-ad95-94d1bcb28b8d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv" Jul 24 14:38:45.663542 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.663490 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv" Jul 24 14:38:45.825600 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:45.825572 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv"] Jul 24 14:38:45.827959 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:38:45.827933 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04d6fc32_2907_4685_ad95_94d1bcb28b8d.slice/crio-d8dea36cd4ee8634f7ffb179678e32ec352096618c71224aeb32e8afa60b4abd WatchSource:0}: Error finding container d8dea36cd4ee8634f7ffb179678e32ec352096618c71224aeb32e8afa60b4abd: Status 404 returned error can't find the container with id d8dea36cd4ee8634f7ffb179678e32ec352096618c71224aeb32e8afa60b4abd Jul 24 14:38:46.022668 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:46.022570 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-clq57" event={"ID":"7c6fae62-81a5-4558-9b8a-a661c9efab08","Type":"ContainerStarted","Data":"c1146e7d59b927033f562da32fea08db919126df6f44b2884fc2257dead1b24a"} Jul 24 14:38:46.022837 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:46.022730 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-clq57" Jul 24 14:38:46.023734 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:46.023706 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv" event={"ID":"04d6fc32-2907-4685-ad95-94d1bcb28b8d","Type":"ContainerStarted","Data":"d8dea36cd4ee8634f7ffb179678e32ec352096618c71224aeb32e8afa60b4abd"} Jul 24 14:38:46.047834 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:46.047788 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-clq57" podStartSLOduration=1.7344735340000002 podStartE2EDuration="4.047772899s" totalImagesPullingTime="2.313299365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:38:46.046504176 +0000 UTC m=+421.603420068" watchObservedRunningTime="2026-07-24 14:38:46.047772899 +0000 UTC m=+421.604688790" Jul 24 14:38:54.013315 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:54.013280 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:38:54.013832 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:54.013489 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tt62v" Jul 24 14:38:55.966649 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:55.966613 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2"] Jul 24 14:38:55.967291 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:55.967018 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" podUID="9d4f70f5-4b4e-4b18-bdf6-0ab159afede4" containerName="manager" containerID="cri-o://8c50d897f540bc1ff665f122ca2d556703819b3c2052d3209827d5e4077bf422" gracePeriod=2 Jul 24 14:38:55.979070 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:38:55.979023 2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9d4f70f5-4b4e-4b18-bdf6-0ab159afede4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-w45c2\": pods \"kuadrant-operator-controller-manager-8684c9ff49-w45c2\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:38:55.980741 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:55.980715 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2"] Jul 24 14:38:56.003256 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.003190 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb"] Jul 24 14:38:56.003784 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.003760 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d4f70f5-4b4e-4b18-bdf6-0ab159afede4" containerName="manager" Jul 24 14:38:56.003784 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.003784 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d4f70f5-4b4e-4b18-bdf6-0ab159afede4" containerName="manager" Jul 24 14:38:56.003985 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.003887 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d4f70f5-4b4e-4b18-bdf6-0ab159afede4" containerName="manager" Jul 24 14:38:56.028081 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:38:56.028028 2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d4f70f5_4b4e_4b18_bdf6_0ab159afede4.slice/crio-8c50d897f540bc1ff665f122ca2d556703819b3c2052d3209827d5e4077bf422.scope\": RecentStats: unable to find data in memory cache]" Jul 24 14:38:56.034653 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.033751 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv"] Jul 24 14:38:56.034653 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.033811 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv"] Jul 24 14:38:56.034653 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.034003 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" podUID="9fe8be2f-2698-4536-a055-7668d29921ab" containerName="manager" containerID="cri-o://37c961f3cd3cfb394f616187dd37605d6a707ee95451c5d0b74f0dd0a02bf74f" gracePeriod=2 Jul 24 14:38:56.034653 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.034211 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" Jul 24 14:38:56.035626 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.035599 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb"] Jul 24 14:38:56.062220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.062181 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dsp9v"] Jul 24 14:38:56.062749 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.062726 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fe8be2f-2698-4536-a055-7668d29921ab" containerName="manager" Jul 24 14:38:56.062850 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.062752 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fe8be2f-2698-4536-a055-7668d29921ab" containerName="manager" Jul 24 14:38:56.062850 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.062822 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fe8be2f-2698-4536-a055-7668d29921ab" containerName="manager" Jul 24 14:38:56.065827 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:38:56.065795 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w45c2\" is forbidden: User \"system:node:ip-10-0-142-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-64.ec2.internal' and this object" podUID="9d4f70f5-4b4e-4b18-bdf6-0ab159afede4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:38:56.067521 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.067487 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dsp9v" Jul 24 14:38:56.067907 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:38:56.067878 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q6wqv\" is forbidden: User \"system:node:ip-10-0-142-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-64.ec2.internal' and this object" podUID="9fe8be2f-2698-4536-a055-7668d29921ab" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:38:56.070138 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:38:56.070108 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w45c2\" is forbidden: User \"system:node:ip-10-0-142-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-64.ec2.internal' and this object" podUID="9d4f70f5-4b4e-4b18-bdf6-0ab159afede4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:38:56.072209 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:38:56.072180 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q6wqv\" is forbidden: User \"system:node:ip-10-0-142-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-64.ec2.internal' and this object" podUID="9fe8be2f-2698-4536-a055-7668d29921ab" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:38:56.077205 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.077179 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dsp9v"] Jul 24 14:38:56.106572 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.106522 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ddac91a-b4e9-41b2-abfc-bd095e11558b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85swb\" (UID: \"5ddac91a-b4e9-41b2-abfc-bd095e11558b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" Jul 24 14:38:56.106740 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.106592 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr92m\" (UniqueName: \"kubernetes.io/projected/5ddac91a-b4e9-41b2-abfc-bd095e11558b-kube-api-access-sr92m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85swb\" (UID: \"5ddac91a-b4e9-41b2-abfc-bd095e11558b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" Jul 24 14:38:56.207575 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.207513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ddac91a-b4e9-41b2-abfc-bd095e11558b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85swb\" (UID: \"5ddac91a-b4e9-41b2-abfc-bd095e11558b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" Jul 24 14:38:56.207778 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.207649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr92m\" (UniqueName: \"kubernetes.io/projected/5ddac91a-b4e9-41b2-abfc-bd095e11558b-kube-api-access-sr92m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85swb\" (UID: \"5ddac91a-b4e9-41b2-abfc-bd095e11558b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" Jul 24 14:38:56.207778 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.207720 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6chz5\" (UniqueName: \"kubernetes.io/projected/dbb9f199-3d86-4786-9690-6acdd382f587-kube-api-access-6chz5\") pod \"limitador-operator-controller-manager-859d7b78bd-dsp9v\" (UID: \"dbb9f199-3d86-4786-9690-6acdd382f587\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dsp9v" Jul 24 14:38:56.208071 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.208048 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ddac91a-b4e9-41b2-abfc-bd095e11558b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85swb\" (UID: \"5ddac91a-b4e9-41b2-abfc-bd095e11558b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" Jul 24 14:38:56.217169 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.217096 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr92m\" (UniqueName: \"kubernetes.io/projected/5ddac91a-b4e9-41b2-abfc-bd095e11558b-kube-api-access-sr92m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-85swb\" (UID: \"5ddac91a-b4e9-41b2-abfc-bd095e11558b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" Jul 24 14:38:56.308326 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.308280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6chz5\" (UniqueName: \"kubernetes.io/projected/dbb9f199-3d86-4786-9690-6acdd382f587-kube-api-access-6chz5\") pod \"limitador-operator-controller-manager-859d7b78bd-dsp9v\" (UID: \"dbb9f199-3d86-4786-9690-6acdd382f587\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dsp9v" Jul 24 14:38:56.318450 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.318422 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6chz5\" (UniqueName: \"kubernetes.io/projected/dbb9f199-3d86-4786-9690-6acdd382f587-kube-api-access-6chz5\") pod \"limitador-operator-controller-manager-859d7b78bd-dsp9v\" (UID: \"dbb9f199-3d86-4786-9690-6acdd382f587\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dsp9v" Jul 24 14:38:56.417872 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.417835 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" Jul 24 14:38:56.424980 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.424951 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dsp9v" Jul 24 14:38:56.960729 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.960694 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj"] Jul 24 14:38:56.985687 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.985656 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj"] Jul 24 14:38:56.986205 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:56.985803 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" Jul 24 14:38:57.014854 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:57.014810 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rsct\" (UniqueName: \"kubernetes.io/projected/fd130668-1b70-421d-bbc0-3de678952be4-kube-api-access-8rsct\") pod \"kuadrant-operator-controller-manager-86878c769f-j6bgj\" (UID: \"fd130668-1b70-421d-bbc0-3de678952be4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" Jul 24 14:38:57.015033 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:57.014890 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd130668-1b70-421d-bbc0-3de678952be4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-j6bgj\" (UID: \"fd130668-1b70-421d-bbc0-3de678952be4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" Jul 24 14:38:57.017065 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:38:57.017024 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w45c2\" is forbidden: User \"system:node:ip-10-0-142-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-64.ec2.internal' and this object" podUID="9d4f70f5-4b4e-4b18-bdf6-0ab159afede4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:38:57.020261 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:38:57.020231 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q6wqv\" is forbidden: User \"system:node:ip-10-0-142-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-64.ec2.internal' and this object" podUID="9fe8be2f-2698-4536-a055-7668d29921ab" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:38:57.033313 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:57.033289 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-clq57" Jul 24 14:38:57.116240 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:57.116203 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rsct\" (UniqueName: \"kubernetes.io/projected/fd130668-1b70-421d-bbc0-3de678952be4-kube-api-access-8rsct\") pod \"kuadrant-operator-controller-manager-86878c769f-j6bgj\" (UID: \"fd130668-1b70-421d-bbc0-3de678952be4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" Jul 24 14:38:57.116419 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:57.116257 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd130668-1b70-421d-bbc0-3de678952be4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-j6bgj\" (UID: \"fd130668-1b70-421d-bbc0-3de678952be4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" Jul 24 14:38:57.116704 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:57.116677 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd130668-1b70-421d-bbc0-3de678952be4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-j6bgj\" (UID: \"fd130668-1b70-421d-bbc0-3de678952be4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" Jul 24 14:38:57.154386 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:57.154353 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rsct\" (UniqueName: \"kubernetes.io/projected/fd130668-1b70-421d-bbc0-3de678952be4-kube-api-access-8rsct\") pod \"kuadrant-operator-controller-manager-86878c769f-j6bgj\" (UID: \"fd130668-1b70-421d-bbc0-3de678952be4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" Jul 24 14:38:57.301014 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:38:57.300973 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" Jul 24 14:39:07.160142 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:07.159629 2581 generic.go:356] "Generic (PLEG): container finished" podID="9d4f70f5-4b4e-4b18-bdf6-0ab159afede4" containerID="8c50d897f540bc1ff665f122ca2d556703819b3c2052d3209827d5e4077bf422" exitCode=0 Jul 24 14:39:07.162272 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:07.161890 2581 generic.go:356] "Generic (PLEG): container finished" podID="9fe8be2f-2698-4536-a055-7668d29921ab" containerID="37c961f3cd3cfb394f616187dd37605d6a707ee95451c5d0b74f0dd0a02bf74f" exitCode=0 Jul 24 14:39:07.235183 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:07.235135 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dsp9v"] Jul 24 14:39:07.259207 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:07.259114 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj"] Jul 24 14:39:07.283060 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:07.283030 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb"] Jul 24 14:39:07.420431 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:39:07.420344 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb9f199_3d86_4786_9690_6acdd382f587.slice/crio-dbe7afab571b8f825b7123cbe903b6743196ba8dca61360b240ed8bc95dee332 WatchSource:0}: Error finding container dbe7afab571b8f825b7123cbe903b6743196ba8dca61360b240ed8bc95dee332: Status 404 returned error can't find the container with id dbe7afab571b8f825b7123cbe903b6743196ba8dca61360b240ed8bc95dee332 Jul 24 14:39:07.421383 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:39:07.421342 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd130668_1b70_421d_bbc0_3de678952be4.slice/crio-ae2b1502034595b08056295c114d7ec3fcf1c9863ecea99f41e02159b02f0c25 WatchSource:0}: Error finding container ae2b1502034595b08056295c114d7ec3fcf1c9863ecea99f41e02159b02f0c25: Status 404 returned error can't find the container with id ae2b1502034595b08056295c114d7ec3fcf1c9863ecea99f41e02159b02f0c25 Jul 24 14:39:07.422466 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:39:07.422444 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ddac91a_b4e9_41b2_abfc_bd095e11558b.slice/crio-1780f9487c7b6040d96d9210f06d654c83717b935aa30981ead7197b27be27ca WatchSource:0}: Error finding container 1780f9487c7b6040d96d9210f06d654c83717b935aa30981ead7197b27be27ca: Status 404 returned error can't find the container with id 1780f9487c7b6040d96d9210f06d654c83717b935aa30981ead7197b27be27ca Jul 24 14:39:07.466226 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:07.466200 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:39:07.468170 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:39:07.468142 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q6wqv\" is forbidden: User \"system:node:ip-10-0-142-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-64.ec2.internal' and this object" podUID="9fe8be2f-2698-4536-a055-7668d29921ab" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:39:07.488110 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:07.488087 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:39:07.491031 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:39:07.490996 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w45c2\" is forbidden: User \"system:node:ip-10-0-142-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-64.ec2.internal' and this object" podUID="9d4f70f5-4b4e-4b18-bdf6-0ab159afede4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:39:07.492739 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:39:07.492712 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q6wqv\" is forbidden: User \"system:node:ip-10-0-142-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-64.ec2.internal' and this object" podUID="9fe8be2f-2698-4536-a055-7668d29921ab" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:39:07.511215 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:07.511187 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwm4s\" (UniqueName: \"kubernetes.io/projected/9d4f70f5-4b4e-4b18-bdf6-0ab159afede4-kube-api-access-qwm4s\") pod \"9d4f70f5-4b4e-4b18-bdf6-0ab159afede4\" (UID: \"9d4f70f5-4b4e-4b18-bdf6-0ab159afede4\") " Jul 24 14:39:07.511366 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:07.511348 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d4f70f5-4b4e-4b18-bdf6-0ab159afede4-extensions-socket-volume\") pod \"9d4f70f5-4b4e-4b18-bdf6-0ab159afede4\" (UID: \"9d4f70f5-4b4e-4b18-bdf6-0ab159afede4\") " Jul 24 14:39:07.511416 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:07.511386 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5lcj\" (UniqueName: \"kubernetes.io/projected/9fe8be2f-2698-4536-a055-7668d29921ab-kube-api-access-s5lcj\") pod \"9fe8be2f-2698-4536-a055-7668d29921ab\" (UID: \"9fe8be2f-2698-4536-a055-7668d29921ab\") " Jul 24 14:39:07.511777 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:07.511751 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d4f70f5-4b4e-4b18-bdf6-0ab159afede4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9d4f70f5-4b4e-4b18-bdf6-0ab159afede4" (UID: "9d4f70f5-4b4e-4b18-bdf6-0ab159afede4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:39:07.513888 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:07.513862 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fe8be2f-2698-4536-a055-7668d29921ab-kube-api-access-s5lcj" (OuterVolumeSpecName: "kube-api-access-s5lcj") pod "9fe8be2f-2698-4536-a055-7668d29921ab" (UID: "9fe8be2f-2698-4536-a055-7668d29921ab"). InnerVolumeSpecName "kube-api-access-s5lcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:39:07.514836 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:07.514808 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d4f70f5-4b4e-4b18-bdf6-0ab159afede4-kube-api-access-qwm4s" (OuterVolumeSpecName: "kube-api-access-qwm4s") pod "9d4f70f5-4b4e-4b18-bdf6-0ab159afede4" (UID: "9d4f70f5-4b4e-4b18-bdf6-0ab159afede4"). InnerVolumeSpecName "kube-api-access-qwm4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:39:07.612917 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:07.612886 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwm4s\" (UniqueName: \"kubernetes.io/projected/9d4f70f5-4b4e-4b18-bdf6-0ab159afede4-kube-api-access-qwm4s\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:39:07.612917 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:07.612915 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d4f70f5-4b4e-4b18-bdf6-0ab159afede4-extensions-socket-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:39:07.613044 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:07.612929 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5lcj\" (UniqueName: \"kubernetes.io/projected/9fe8be2f-2698-4536-a055-7668d29921ab-kube-api-access-s5lcj\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:39:08.168903 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.168873 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:39:08.169296 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.168877 2581 scope.go:117] "RemoveContainer" containerID="8c50d897f540bc1ff665f122ca2d556703819b3c2052d3209827d5e4077bf422" Jul 24 14:39:08.170487 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.170355 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:39:08.171367 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:39:08.171319 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w45c2\" is forbidden: User \"system:node:ip-10-0-142-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-64.ec2.internal' and this object" podUID="9d4f70f5-4b4e-4b18-bdf6-0ab159afede4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:39:08.172207 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.172176 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dsp9v" event={"ID":"dbb9f199-3d86-4786-9690-6acdd382f587","Type":"ContainerStarted","Data":"ce8656d1b5e76dedad41f9804d2fad0822439d7f9d29f037f25db0d4cc528448"} Jul 24 14:39:08.172337 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.172264 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dsp9v" Jul 24 14:39:08.172337 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.172289 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dsp9v" event={"ID":"dbb9f199-3d86-4786-9690-6acdd382f587","Type":"ContainerStarted","Data":"dbe7afab571b8f825b7123cbe903b6743196ba8dca61360b240ed8bc95dee332"} Jul 24 14:39:08.173317 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:39:08.173293 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q6wqv\" is forbidden: User \"system:node:ip-10-0-142-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-64.ec2.internal' and this object" podUID="9fe8be2f-2698-4536-a055-7668d29921ab" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:39:08.174027 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.173992 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" event={"ID":"fd130668-1b70-421d-bbc0-3de678952be4","Type":"ContainerStarted","Data":"40e4256408377ce8ce58c91f584fac5eba211eb523e1722d263265f32c448d03"} Jul 24 14:39:08.174122 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.174043 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" event={"ID":"fd130668-1b70-421d-bbc0-3de678952be4","Type":"ContainerStarted","Data":"ae2b1502034595b08056295c114d7ec3fcf1c9863ecea99f41e02159b02f0c25"} Jul 24 14:39:08.174181 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.174131 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" Jul 24 14:39:08.175293 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:39:08.175260 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w45c2\" is forbidden: User \"system:node:ip-10-0-142-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-64.ec2.internal' and this object" podUID="9d4f70f5-4b4e-4b18-bdf6-0ab159afede4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:39:08.175960 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.175940 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" event={"ID":"5ddac91a-b4e9-41b2-abfc-bd095e11558b","Type":"ContainerStarted","Data":"748b48eb6939384ca9fd21b2c99fab14129f608f57bd067c069244a32cafdbcd"} Jul 24 14:39:08.176061 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.175983 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" event={"ID":"5ddac91a-b4e9-41b2-abfc-bd095e11558b","Type":"ContainerStarted","Data":"1780f9487c7b6040d96d9210f06d654c83717b935aa30981ead7197b27be27ca"} Jul 24 14:39:08.176061 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.176006 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" Jul 24 14:39:08.177122 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:39:08.177095 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q6wqv\" is forbidden: User \"system:node:ip-10-0-142-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-64.ec2.internal' and this object" podUID="9fe8be2f-2698-4536-a055-7668d29921ab" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:39:08.177677 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.177648 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv" event={"ID":"04d6fc32-2907-4685-ad95-94d1bcb28b8d","Type":"ContainerStarted","Data":"24b7c6141dd76a597eb22f216d2973a2173fd37532ea08e09fb452d1af5b12a0"} Jul 24 14:39:08.180329 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.180310 2581 scope.go:117] "RemoveContainer" containerID="37c961f3cd3cfb394f616187dd37605d6a707ee95451c5d0b74f0dd0a02bf74f" Jul 24 14:39:08.194408 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.194369 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dsp9v" podStartSLOduration=12.194355568 podStartE2EDuration="12.194355568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:38:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:39:08.193637039 +0000 UTC m=+443.750552931" watchObservedRunningTime="2026-07-24 14:39:08.194355568 +0000 UTC m=+443.751271459" Jul 24 14:39:08.195810 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:39:08.195788 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-w45c2\" is forbidden: User \"system:node:ip-10-0-142-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-64.ec2.internal' and this object" podUID="9d4f70f5-4b4e-4b18-bdf6-0ab159afede4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w45c2" Jul 24 14:39:08.197611 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:39:08.197583 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q6wqv\" is forbidden: User \"system:node:ip-10-0-142-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-64.ec2.internal' and this object" podUID="9fe8be2f-2698-4536-a055-7668d29921ab" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q6wqv" Jul 24 14:39:08.215508 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.215468 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fd4dv" podStartSLOduration=1.550881241 podStartE2EDuration="23.215454416s" totalImagesPullingTime="21.664573175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:39:08.214656203 +0000 UTC m=+443.771572095" watchObservedRunningTime="2026-07-24 14:39:08.215454416 +0000 UTC m=+443.772370307" Jul 24 14:39:08.235837 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.235785 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" podStartSLOduration=13.235770167 podStartE2EDuration="13.235770167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:39:08.233855727 +0000 UTC m=+443.790771632" watchObservedRunningTime="2026-07-24 14:39:08.235770167 +0000 UTC m=+443.792686122" Jul 24 14:39:08.253146 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.253096 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" podStartSLOduration=12.253081392 podStartE2EDuration="12.253081392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:38:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:39:08.25093442 +0000 UTC m=+443.807850315" watchObservedRunningTime="2026-07-24 14:39:08.253081392 +0000 UTC m=+443.809997284" Jul 24 14:39:08.973108 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.973072 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d4f70f5-4b4e-4b18-bdf6-0ab159afede4" path="/var/lib/kubelet/pods/9d4f70f5-4b4e-4b18-bdf6-0ab159afede4/volumes" Jul 24 14:39:08.973402 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:08.973389 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fe8be2f-2698-4536-a055-7668d29921ab" path="/var/lib/kubelet/pods/9fe8be2f-2698-4536-a055-7668d29921ab/volumes" Jul 24 14:39:19.187339 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:19.187306 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dsp9v" Jul 24 14:39:19.187836 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:19.187396 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" Jul 24 14:39:19.187836 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:19.187584 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" Jul 24 14:39:19.303374 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:19.303340 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb"] Jul 24 14:39:19.303592 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:19.303564 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" podUID="5ddac91a-b4e9-41b2-abfc-bd095e11558b" containerName="manager" containerID="cri-o://748b48eb6939384ca9fd21b2c99fab14129f608f57bd067c069244a32cafdbcd" gracePeriod=10 Jul 24 14:39:19.559610 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:19.559583 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" Jul 24 14:39:19.616341 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:19.616310 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sr92m\" (UniqueName: \"kubernetes.io/projected/5ddac91a-b4e9-41b2-abfc-bd095e11558b-kube-api-access-sr92m\") pod \"5ddac91a-b4e9-41b2-abfc-bd095e11558b\" (UID: \"5ddac91a-b4e9-41b2-abfc-bd095e11558b\") " Jul 24 14:39:19.616523 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:19.616358 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ddac91a-b4e9-41b2-abfc-bd095e11558b-extensions-socket-volume\") pod \"5ddac91a-b4e9-41b2-abfc-bd095e11558b\" (UID: \"5ddac91a-b4e9-41b2-abfc-bd095e11558b\") " Jul 24 14:39:19.616810 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:19.616779 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ddac91a-b4e9-41b2-abfc-bd095e11558b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5ddac91a-b4e9-41b2-abfc-bd095e11558b" (UID: "5ddac91a-b4e9-41b2-abfc-bd095e11558b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:39:19.618362 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:19.618333 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ddac91a-b4e9-41b2-abfc-bd095e11558b-kube-api-access-sr92m" (OuterVolumeSpecName: "kube-api-access-sr92m") pod "5ddac91a-b4e9-41b2-abfc-bd095e11558b" (UID: "5ddac91a-b4e9-41b2-abfc-bd095e11558b"). InnerVolumeSpecName "kube-api-access-sr92m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:39:19.717073 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:19.717040 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sr92m\" (UniqueName: \"kubernetes.io/projected/5ddac91a-b4e9-41b2-abfc-bd095e11558b-kube-api-access-sr92m\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:39:19.717073 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:19.717073 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ddac91a-b4e9-41b2-abfc-bd095e11558b-extensions-socket-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:39:20.241341 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:20.241304 2581 generic.go:356] "Generic (PLEG): container finished" podID="5ddac91a-b4e9-41b2-abfc-bd095e11558b" containerID="748b48eb6939384ca9fd21b2c99fab14129f608f57bd067c069244a32cafdbcd" exitCode=0 Jul 24 14:39:20.241741 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:20.241356 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" Jul 24 14:39:20.241741 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:20.241391 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" event={"ID":"5ddac91a-b4e9-41b2-abfc-bd095e11558b","Type":"ContainerDied","Data":"748b48eb6939384ca9fd21b2c99fab14129f608f57bd067c069244a32cafdbcd"} Jul 24 14:39:20.241741 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:20.241451 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb" event={"ID":"5ddac91a-b4e9-41b2-abfc-bd095e11558b","Type":"ContainerDied","Data":"1780f9487c7b6040d96d9210f06d654c83717b935aa30981ead7197b27be27ca"} Jul 24 14:39:20.241741 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:20.241474 2581 scope.go:117] "RemoveContainer" containerID="748b48eb6939384ca9fd21b2c99fab14129f608f57bd067c069244a32cafdbcd" Jul 24 14:39:20.251476 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:20.251459 2581 scope.go:117] "RemoveContainer" containerID="748b48eb6939384ca9fd21b2c99fab14129f608f57bd067c069244a32cafdbcd" Jul 24 14:39:20.251779 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:39:20.251758 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"748b48eb6939384ca9fd21b2c99fab14129f608f57bd067c069244a32cafdbcd\": container with ID starting with 748b48eb6939384ca9fd21b2c99fab14129f608f57bd067c069244a32cafdbcd not found: ID does not exist" containerID="748b48eb6939384ca9fd21b2c99fab14129f608f57bd067c069244a32cafdbcd" Jul 24 14:39:20.251840 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:20.251787 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748b48eb6939384ca9fd21b2c99fab14129f608f57bd067c069244a32cafdbcd"} err="failed to get container status \"748b48eb6939384ca9fd21b2c99fab14129f608f57bd067c069244a32cafdbcd\": rpc error: code = NotFound desc = could not find container \"748b48eb6939384ca9fd21b2c99fab14129f608f57bd067c069244a32cafdbcd\": container with ID starting with 748b48eb6939384ca9fd21b2c99fab14129f608f57bd067c069244a32cafdbcd not found: ID does not exist" Jul 24 14:39:20.277437 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:20.277407 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb"] Jul 24 14:39:20.281571 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:20.281548 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-85swb"] Jul 24 14:39:20.972095 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:20.972061 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ddac91a-b4e9-41b2-abfc-bd095e11558b" path="/var/lib/kubelet/pods/5ddac91a-b4e9-41b2-abfc-bd095e11558b/volumes" Jul 24 14:39:35.938377 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:35.938337 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr"] Jul 24 14:39:35.938936 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:35.938915 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ddac91a-b4e9-41b2-abfc-bd095e11558b" containerName="manager" Jul 24 14:39:35.939012 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:35.938938 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ddac91a-b4e9-41b2-abfc-bd095e11558b" containerName="manager" Jul 24 14:39:35.939066 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:35.939055 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ddac91a-b4e9-41b2-abfc-bd095e11558b" containerName="manager" Jul 24 14:39:35.997258 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:35.997222 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr"] Jul 24 14:39:35.997418 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:35.997343 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.000006 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:35.999984 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rc6zd\"" Jul 24 14:39:36.169255 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.169216 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38085a88-3c89-4270-8eaa-e0cc58066f1b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.169255 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.169256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38085a88-3c89-4270-8eaa-e0cc58066f1b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.169502 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.169275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38085a88-3c89-4270-8eaa-e0cc58066f1b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.169502 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.169298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38085a88-3c89-4270-8eaa-e0cc58066f1b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.169502 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.169321 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n44n\" (UniqueName: \"kubernetes.io/projected/38085a88-3c89-4270-8eaa-e0cc58066f1b-kube-api-access-4n44n\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.169502 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.169344 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38085a88-3c89-4270-8eaa-e0cc58066f1b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.169502 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.169384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38085a88-3c89-4270-8eaa-e0cc58066f1b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.169502 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.169416 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38085a88-3c89-4270-8eaa-e0cc58066f1b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.169502 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.169489 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38085a88-3c89-4270-8eaa-e0cc58066f1b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.270681 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.270597 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38085a88-3c89-4270-8eaa-e0cc58066f1b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.270681 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.270636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38085a88-3c89-4270-8eaa-e0cc58066f1b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.270912 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.270767 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38085a88-3c89-4270-8eaa-e0cc58066f1b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.270912 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.270815 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38085a88-3c89-4270-8eaa-e0cc58066f1b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.270912 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.270841 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38085a88-3c89-4270-8eaa-e0cc58066f1b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.270912 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.270871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38085a88-3c89-4270-8eaa-e0cc58066f1b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.270912 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.270895 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38085a88-3c89-4270-8eaa-e0cc58066f1b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.271127 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.270918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n44n\" (UniqueName: \"kubernetes.io/projected/38085a88-3c89-4270-8eaa-e0cc58066f1b-kube-api-access-4n44n\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.271127 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.270961 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38085a88-3c89-4270-8eaa-e0cc58066f1b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.271268 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.271234 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38085a88-3c89-4270-8eaa-e0cc58066f1b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.271422 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.271398 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38085a88-3c89-4270-8eaa-e0cc58066f1b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.271498 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.271465 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38085a88-3c89-4270-8eaa-e0cc58066f1b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.271498 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.271484 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38085a88-3c89-4270-8eaa-e0cc58066f1b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.271617 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.271466 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38085a88-3c89-4270-8eaa-e0cc58066f1b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.273107 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.273073 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38085a88-3c89-4270-8eaa-e0cc58066f1b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.273382 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.273362 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38085a88-3c89-4270-8eaa-e0cc58066f1b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.278733 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.278712 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38085a88-3c89-4270-8eaa-e0cc58066f1b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.278922 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.278903 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n44n\" (UniqueName: \"kubernetes.io/projected/38085a88-3c89-4270-8eaa-e0cc58066f1b-kube-api-access-4n44n\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smxsr\" (UID: \"38085a88-3c89-4270-8eaa-e0cc58066f1b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.310554 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.310498 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:36.455044 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.455021 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr"] Jul 24 14:39:36.457047 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:39:36.457021 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38085a88_3c89_4270_8eaa_e0cc58066f1b.slice/crio-db26a5df4efc345eb723c7ca69063696e93550ccf06013b8b64121d7a2cd56a1 WatchSource:0}: Error finding container db26a5df4efc345eb723c7ca69063696e93550ccf06013b8b64121d7a2cd56a1: Status 404 returned error can't find the container with id db26a5df4efc345eb723c7ca69063696e93550ccf06013b8b64121d7a2cd56a1 Jul 24 14:39:36.459272 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.459226 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:39:36.459366 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.459308 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:39:36.459366 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:36.459340 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:39:37.327396 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:37.327357 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" event={"ID":"38085a88-3c89-4270-8eaa-e0cc58066f1b","Type":"ContainerStarted","Data":"1857b868fe18aa34bc3a63a8687369c44f88e6fab8af116b17dc88a3a06e4a48"} Jul 24 14:39:37.327819 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:37.327423 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" event={"ID":"38085a88-3c89-4270-8eaa-e0cc58066f1b","Type":"ContainerStarted","Data":"db26a5df4efc345eb723c7ca69063696e93550ccf06013b8b64121d7a2cd56a1"} Jul 24 14:39:37.351890 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:37.351835 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" podStartSLOduration=2.351817618 podStartE2EDuration="2.351817618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:39:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:39:37.349972905 +0000 UTC m=+472.906888797" watchObservedRunningTime="2026-07-24 14:39:37.351817618 +0000 UTC m=+472.908733510" Jul 24 14:39:38.311635 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:38.311598 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:38.316559 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:38.316519 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:38.333155 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:38.333119 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:38.333898 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:38.333877 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:39:39.497595 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:39.497565 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7mx2t"] Jul 24 14:39:39.500744 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:39.500724 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7mx2t" Jul 24 14:39:39.503699 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:39.503680 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xwk6h\"" Jul 24 14:39:39.515929 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:39.515901 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7mx2t"] Jul 24 14:39:39.602216 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:39.602174 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t56vz\" (UniqueName: \"kubernetes.io/projected/6e1bdfa9-564b-4b49-a7ce-05baa75ca69e-kube-api-access-t56vz\") pod \"authorino-75d556bd77-7mx2t\" (UID: \"6e1bdfa9-564b-4b49-a7ce-05baa75ca69e\") " pod="kuadrant-system/authorino-75d556bd77-7mx2t" Jul 24 14:39:39.703451 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:39.703407 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t56vz\" (UniqueName: \"kubernetes.io/projected/6e1bdfa9-564b-4b49-a7ce-05baa75ca69e-kube-api-access-t56vz\") pod \"authorino-75d556bd77-7mx2t\" (UID: \"6e1bdfa9-564b-4b49-a7ce-05baa75ca69e\") " pod="kuadrant-system/authorino-75d556bd77-7mx2t" Jul 24 14:39:39.716197 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:39.716171 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t56vz\" (UniqueName: \"kubernetes.io/projected/6e1bdfa9-564b-4b49-a7ce-05baa75ca69e-kube-api-access-t56vz\") pod \"authorino-75d556bd77-7mx2t\" (UID: \"6e1bdfa9-564b-4b49-a7ce-05baa75ca69e\") " pod="kuadrant-system/authorino-75d556bd77-7mx2t" Jul 24 14:39:39.810409 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:39.810376 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7mx2t" Jul 24 14:39:39.945253 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:39.945221 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7mx2t"] Jul 24 14:39:39.948952 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:39:39.948927 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e1bdfa9_564b_4b49_a7ce_05baa75ca69e.slice/crio-6bcf9a31609de15717e510a39455df21751bad578722e0259214c5f27fc45382 WatchSource:0}: Error finding container 6bcf9a31609de15717e510a39455df21751bad578722e0259214c5f27fc45382: Status 404 returned error can't find the container with id 6bcf9a31609de15717e510a39455df21751bad578722e0259214c5f27fc45382 Jul 24 14:39:40.345205 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:40.345164 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7mx2t" event={"ID":"6e1bdfa9-564b-4b49-a7ce-05baa75ca69e","Type":"ContainerStarted","Data":"6bcf9a31609de15717e510a39455df21751bad578722e0259214c5f27fc45382"} Jul 24 14:39:43.365665 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:43.365632 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7mx2t" event={"ID":"6e1bdfa9-564b-4b49-a7ce-05baa75ca69e","Type":"ContainerStarted","Data":"b159b4423cc7a2c45ccf5f9182c61f40089eafc40e80d31853a5ab468eb6bbcb"} Jul 24 14:39:43.384126 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:43.384072 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7mx2t" podStartSLOduration=1.5671541439999999 podStartE2EDuration="4.384056505s" totalImagesPullingTime="2.816902361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:39:43.382662482 +0000 UTC m=+478.939578374" watchObservedRunningTime="2026-07-24 14:39:43.384056505 +0000 UTC m=+478.940972397" Jul 24 14:39:45.686019 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:39:45.685983 2581 scope.go:117] "RemoveContainer" containerID="5a14c9cbf9b9cb3d8367c7496650d1642d9f225e88f6912e7c6763c4217343b5" Jul 24 14:40:13.547651 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:13.547617 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f8b77647-f7p82"] Jul 24 14:40:13.551072 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:13.551053 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f8b77647-f7p82" Jul 24 14:40:13.556372 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:13.556341 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 24 14:40:13.581955 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:13.581912 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f8b77647-f7p82"] Jul 24 14:40:13.614834 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:13.614794 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4167ddfd-e3f6-4504-b707-41651f4b526f-tls-cert\") pod \"authorino-7f8b77647-f7p82\" (UID: \"4167ddfd-e3f6-4504-b707-41651f4b526f\") " pod="kuadrant-system/authorino-7f8b77647-f7p82" Jul 24 14:40:13.615019 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:13.614861 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ls8v\" (UniqueName: \"kubernetes.io/projected/4167ddfd-e3f6-4504-b707-41651f4b526f-kube-api-access-9ls8v\") pod \"authorino-7f8b77647-f7p82\" (UID: \"4167ddfd-e3f6-4504-b707-41651f4b526f\") " pod="kuadrant-system/authorino-7f8b77647-f7p82" Jul 24 14:40:13.715452 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:13.715414 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ls8v\" (UniqueName: \"kubernetes.io/projected/4167ddfd-e3f6-4504-b707-41651f4b526f-kube-api-access-9ls8v\") pod \"authorino-7f8b77647-f7p82\" (UID: \"4167ddfd-e3f6-4504-b707-41651f4b526f\") " pod="kuadrant-system/authorino-7f8b77647-f7p82" Jul 24 14:40:13.715677 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:13.715494 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4167ddfd-e3f6-4504-b707-41651f4b526f-tls-cert\") pod \"authorino-7f8b77647-f7p82\" (UID: \"4167ddfd-e3f6-4504-b707-41651f4b526f\") " pod="kuadrant-system/authorino-7f8b77647-f7p82" Jul 24 14:40:13.717847 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:13.717827 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4167ddfd-e3f6-4504-b707-41651f4b526f-tls-cert\") pod \"authorino-7f8b77647-f7p82\" (UID: \"4167ddfd-e3f6-4504-b707-41651f4b526f\") " pod="kuadrant-system/authorino-7f8b77647-f7p82" Jul 24 14:40:13.727115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:13.727091 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ls8v\" (UniqueName: \"kubernetes.io/projected/4167ddfd-e3f6-4504-b707-41651f4b526f-kube-api-access-9ls8v\") pod \"authorino-7f8b77647-f7p82\" (UID: \"4167ddfd-e3f6-4504-b707-41651f4b526f\") " pod="kuadrant-system/authorino-7f8b77647-f7p82" Jul 24 14:40:13.861423 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:13.861342 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f8b77647-f7p82" Jul 24 14:40:13.999981 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:13.998603 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f8b77647-f7p82"] Jul 24 14:40:14.004285 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:40:14.004247 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4167ddfd_e3f6_4504_b707_41651f4b526f.slice/crio-97cebfeda51182b711eff6f1a3e249dfe4ff1eba70aaab046833f39689ab8fde WatchSource:0}: Error finding container 97cebfeda51182b711eff6f1a3e249dfe4ff1eba70aaab046833f39689ab8fde: Status 404 returned error can't find the container with id 97cebfeda51182b711eff6f1a3e249dfe4ff1eba70aaab046833f39689ab8fde Jul 24 14:40:14.517989 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:14.517953 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f8b77647-f7p82" event={"ID":"4167ddfd-e3f6-4504-b707-41651f4b526f","Type":"ContainerStarted","Data":"97cebfeda51182b711eff6f1a3e249dfe4ff1eba70aaab046833f39689ab8fde"} Jul 24 14:40:16.528513 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:16.528478 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f8b77647-f7p82" event={"ID":"4167ddfd-e3f6-4504-b707-41651f4b526f","Type":"ContainerStarted","Data":"767118bbba6d9b0c0bb23634affa00085fe05f7fabc87b1b91fda8c0bac21e96"} Jul 24 14:40:16.545996 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:16.545885 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f8b77647-f7p82" podStartSLOduration=1.264586661 podStartE2EDuration="3.545865598s" totalImagesPullingTime="2.281278937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:16.545674144 +0000 UTC m=+512.102590038" watchObservedRunningTime="2026-07-24 14:40:16.545865598 +0000 UTC m=+512.102781492" Jul 24 14:40:16.570803 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:16.570767 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7mx2t"] Jul 24 14:40:16.570970 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:16.570947 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7mx2t" podUID="6e1bdfa9-564b-4b49-a7ce-05baa75ca69e" containerName="authorino" containerID="cri-o://b159b4423cc7a2c45ccf5f9182c61f40089eafc40e80d31853a5ab468eb6bbcb" gracePeriod=30 Jul 24 14:40:16.811347 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:16.811313 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7mx2t" Jul 24 14:40:16.944950 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:16.944913 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t56vz\" (UniqueName: \"kubernetes.io/projected/6e1bdfa9-564b-4b49-a7ce-05baa75ca69e-kube-api-access-t56vz\") pod \"6e1bdfa9-564b-4b49-a7ce-05baa75ca69e\" (UID: \"6e1bdfa9-564b-4b49-a7ce-05baa75ca69e\") " Jul 24 14:40:16.947008 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:16.946981 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e1bdfa9-564b-4b49-a7ce-05baa75ca69e-kube-api-access-t56vz" (OuterVolumeSpecName: "kube-api-access-t56vz") pod "6e1bdfa9-564b-4b49-a7ce-05baa75ca69e" (UID: "6e1bdfa9-564b-4b49-a7ce-05baa75ca69e"). InnerVolumeSpecName "kube-api-access-t56vz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:40:17.045778 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:17.045739 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t56vz\" (UniqueName: \"kubernetes.io/projected/6e1bdfa9-564b-4b49-a7ce-05baa75ca69e-kube-api-access-t56vz\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:40:17.534254 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:17.534217 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e1bdfa9-564b-4b49-a7ce-05baa75ca69e" containerID="b159b4423cc7a2c45ccf5f9182c61f40089eafc40e80d31853a5ab468eb6bbcb" exitCode=0 Jul 24 14:40:17.534254 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:17.534259 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7mx2t" Jul 24 14:40:17.534807 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:17.534292 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7mx2t" event={"ID":"6e1bdfa9-564b-4b49-a7ce-05baa75ca69e","Type":"ContainerDied","Data":"b159b4423cc7a2c45ccf5f9182c61f40089eafc40e80d31853a5ab468eb6bbcb"} Jul 24 14:40:17.534807 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:17.534331 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7mx2t" event={"ID":"6e1bdfa9-564b-4b49-a7ce-05baa75ca69e","Type":"ContainerDied","Data":"6bcf9a31609de15717e510a39455df21751bad578722e0259214c5f27fc45382"} Jul 24 14:40:17.534807 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:17.534348 2581 scope.go:117] "RemoveContainer" containerID="b159b4423cc7a2c45ccf5f9182c61f40089eafc40e80d31853a5ab468eb6bbcb" Jul 24 14:40:17.542720 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:17.542701 2581 scope.go:117] "RemoveContainer" containerID="b159b4423cc7a2c45ccf5f9182c61f40089eafc40e80d31853a5ab468eb6bbcb" Jul 24 14:40:17.543009 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:40:17.542991 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b159b4423cc7a2c45ccf5f9182c61f40089eafc40e80d31853a5ab468eb6bbcb\": container with ID starting with b159b4423cc7a2c45ccf5f9182c61f40089eafc40e80d31853a5ab468eb6bbcb not found: ID does not exist" containerID="b159b4423cc7a2c45ccf5f9182c61f40089eafc40e80d31853a5ab468eb6bbcb" Jul 24 14:40:17.543067 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:17.543021 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b159b4423cc7a2c45ccf5f9182c61f40089eafc40e80d31853a5ab468eb6bbcb"} err="failed to get container status \"b159b4423cc7a2c45ccf5f9182c61f40089eafc40e80d31853a5ab468eb6bbcb\": rpc error: code = NotFound desc = could not find container \"b159b4423cc7a2c45ccf5f9182c61f40089eafc40e80d31853a5ab468eb6bbcb\": container with ID starting with b159b4423cc7a2c45ccf5f9182c61f40089eafc40e80d31853a5ab468eb6bbcb not found: ID does not exist" Jul 24 14:40:17.551329 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:17.551261 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7mx2t"] Jul 24 14:40:17.555060 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:17.555039 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7mx2t"] Jul 24 14:40:18.971986 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:18.971950 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e1bdfa9-564b-4b49-a7ce-05baa75ca69e" path="/var/lib/kubelet/pods/6e1bdfa9-564b-4b49-a7ce-05baa75ca69e/volumes" Jul 24 14:40:59.024387 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.024315 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-4msfc"] Jul 24 14:40:59.024994 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.024784 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e1bdfa9-564b-4b49-a7ce-05baa75ca69e" containerName="authorino" Jul 24 14:40:59.024994 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.024800 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e1bdfa9-564b-4b49-a7ce-05baa75ca69e" containerName="authorino" Jul 24 14:40:59.024994 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.024876 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e1bdfa9-564b-4b49-a7ce-05baa75ca69e" containerName="authorino" Jul 24 14:40:59.029351 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.029333 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-4msfc" Jul 24 14:40:59.031773 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.031750 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 24 14:40:59.031926 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.031906 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-zjjft\"" Jul 24 14:40:59.040698 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.040673 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-4msfc"] Jul 24 14:40:59.113636 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.113603 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b952219-50d1-4744-b6ce-d52d84e57c80-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-4msfc\" (UID: \"4b952219-50d1-4744-b6ce-d52d84e57c80\") " pod="openshift-ingress/payload-processing-5cc6cd444b-4msfc" Jul 24 14:40:59.113830 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.113719 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9czzs\" (UniqueName: \"kubernetes.io/projected/4b952219-50d1-4744-b6ce-d52d84e57c80-kube-api-access-9czzs\") pod \"payload-processing-5cc6cd444b-4msfc\" (UID: \"4b952219-50d1-4744-b6ce-d52d84e57c80\") " pod="openshift-ingress/payload-processing-5cc6cd444b-4msfc" Jul 24 14:40:59.214419 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.214386 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9czzs\" (UniqueName: \"kubernetes.io/projected/4b952219-50d1-4744-b6ce-d52d84e57c80-kube-api-access-9czzs\") pod \"payload-processing-5cc6cd444b-4msfc\" (UID: \"4b952219-50d1-4744-b6ce-d52d84e57c80\") " pod="openshift-ingress/payload-processing-5cc6cd444b-4msfc" Jul 24 14:40:59.214626 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.214440 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b952219-50d1-4744-b6ce-d52d84e57c80-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-4msfc\" (UID: \"4b952219-50d1-4744-b6ce-d52d84e57c80\") " pod="openshift-ingress/payload-processing-5cc6cd444b-4msfc" Jul 24 14:40:59.215096 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.215078 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b952219-50d1-4744-b6ce-d52d84e57c80-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-4msfc\" (UID: \"4b952219-50d1-4744-b6ce-d52d84e57c80\") " pod="openshift-ingress/payload-processing-5cc6cd444b-4msfc" Jul 24 14:40:59.223431 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.223402 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9czzs\" (UniqueName: \"kubernetes.io/projected/4b952219-50d1-4744-b6ce-d52d84e57c80-kube-api-access-9czzs\") pod \"payload-processing-5cc6cd444b-4msfc\" (UID: \"4b952219-50d1-4744-b6ce-d52d84e57c80\") " pod="openshift-ingress/payload-processing-5cc6cd444b-4msfc" Jul 24 14:40:59.340227 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.340189 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-4msfc" Jul 24 14:40:59.487949 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:40:59.487922 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b952219_50d1_4744_b6ce_d52d84e57c80.slice/crio-718f243f7f9f8005ce01f662e8178651ff4e3a250e0846e44114414328de794d WatchSource:0}: Error finding container 718f243f7f9f8005ce01f662e8178651ff4e3a250e0846e44114414328de794d: Status 404 returned error can't find the container with id 718f243f7f9f8005ce01f662e8178651ff4e3a250e0846e44114414328de794d Jul 24 14:40:59.488601 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.488576 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-4msfc"] Jul 24 14:40:59.751209 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:40:59.751100 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-4msfc" event={"ID":"4b952219-50d1-4744-b6ce-d52d84e57c80","Type":"ContainerStarted","Data":"718f243f7f9f8005ce01f662e8178651ff4e3a250e0846e44114414328de794d"} Jul 24 14:41:02.785731 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:02.785694 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-4msfc" event={"ID":"4b952219-50d1-4744-b6ce-d52d84e57c80","Type":"ContainerStarted","Data":"20875d38ff23d0761df45c1cefd414429158d780d5d4a37265f0b25c04d9a0fc"} Jul 24 14:41:02.786119 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:02.785772 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-4msfc" Jul 24 14:41:02.811072 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:02.811022 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-4msfc" podStartSLOduration=1.983140035 podStartE2EDuration="4.811006081s" totalImagesPullingTime="2.827866046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:41:02.810048211 +0000 UTC m=+558.366964104" watchObservedRunningTime="2026-07-24 14:41:02.811006081 +0000 UTC m=+558.367921972" Jul 24 14:41:06.808709 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:06.808618 2581 generic.go:356] "Generic (PLEG): container finished" podID="38085a88-3c89-4270-8eaa-e0cc58066f1b" containerID="1857b868fe18aa34bc3a63a8687369c44f88e6fab8af116b17dc88a3a06e4a48" exitCode=0 Jul 24 14:41:06.808709 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:06.808663 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" event={"ID":"38085a88-3c89-4270-8eaa-e0cc58066f1b","Type":"ContainerDied","Data":"1857b868fe18aa34bc3a63a8687369c44f88e6fab8af116b17dc88a3a06e4a48"} Jul 24 14:41:06.809189 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:06.809066 2581 scope.go:117] "RemoveContainer" containerID="1857b868fe18aa34bc3a63a8687369c44f88e6fab8af116b17dc88a3a06e4a48" Jul 24 14:41:06.810180 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:06.810149 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:41:06.810252 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:06.810235 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:41:06.810291 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:06.810280 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:41:07.815718 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:07.815680 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" event={"ID":"38085a88-3c89-4270-8eaa-e0cc58066f1b","Type":"ContainerStarted","Data":"ef325e3822004985020c8fb43daf15c6c98e06a4c1b3f3a387a746097bd0ec09"} Jul 24 14:41:08.311373 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:08.311332 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:41:08.312552 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:08.312514 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-smxsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 24 14:41:08.312668 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:08.312578 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" podUID="38085a88-3c89-4270-8eaa-e0cc58066f1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 24 14:41:08.333714 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:08.333686 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:41:09.311105 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:09.311069 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-smxsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 24 14:41:09.311607 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:09.311124 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" podUID="38085a88-3c89-4270-8eaa-e0cc58066f1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 24 14:41:10.311075 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:10.311035 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-smxsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 24 14:41:10.311269 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:10.311099 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" podUID="38085a88-3c89-4270-8eaa-e0cc58066f1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 24 14:41:11.311115 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:11.311073 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-smxsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 24 14:41:11.311328 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:11.311135 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" podUID="38085a88-3c89-4270-8eaa-e0cc58066f1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 24 14:41:12.314944 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:12.314912 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:41:12.315902 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:12.315880 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smxsr" Jul 24 14:41:13.793093 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:13.793060 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-4msfc" Jul 24 14:41:37.814780 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.814728 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m"] Jul 24 14:41:37.820437 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.820415 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.822998 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.822977 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 24 14:41:37.823164 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.823144 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gkqfh\"" Jul 24 14:41:37.824006 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.823990 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 24 14:41:37.824098 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.823994 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 24 14:41:37.827367 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.827344 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m"] Jul 24 14:41:37.859149 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.859116 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/783b7dcf-6c7c-433b-b871-7e1cac52f565-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.859321 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.859151 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/783b7dcf-6c7c-433b-b871-7e1cac52f565-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.859321 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.859183 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6s4t\" (UniqueName: \"kubernetes.io/projected/783b7dcf-6c7c-433b-b871-7e1cac52f565-kube-api-access-z6s4t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.859321 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.859205 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/783b7dcf-6c7c-433b-b871-7e1cac52f565-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.859321 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.859288 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/783b7dcf-6c7c-433b-b871-7e1cac52f565-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.859472 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.859371 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/783b7dcf-6c7c-433b-b871-7e1cac52f565-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.960311 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.960274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6s4t\" (UniqueName: \"kubernetes.io/projected/783b7dcf-6c7c-433b-b871-7e1cac52f565-kube-api-access-z6s4t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.960495 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.960340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/783b7dcf-6c7c-433b-b871-7e1cac52f565-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.960495 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.960407 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/783b7dcf-6c7c-433b-b871-7e1cac52f565-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.960495 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.960469 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/783b7dcf-6c7c-433b-b871-7e1cac52f565-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.960707 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.960497 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/783b7dcf-6c7c-433b-b871-7e1cac52f565-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.960707 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.960559 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/783b7dcf-6c7c-433b-b871-7e1cac52f565-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.960872 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.960846 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/783b7dcf-6c7c-433b-b871-7e1cac52f565-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.960986 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.960870 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/783b7dcf-6c7c-433b-b871-7e1cac52f565-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.960986 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.960923 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/783b7dcf-6c7c-433b-b871-7e1cac52f565-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.962968 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.962940 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/783b7dcf-6c7c-433b-b871-7e1cac52f565-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.963160 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.963142 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/783b7dcf-6c7c-433b-b871-7e1cac52f565-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:37.968938 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:37.968909 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6s4t\" (UniqueName: \"kubernetes.io/projected/783b7dcf-6c7c-433b-b871-7e1cac52f565-kube-api-access-z6s4t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m\" (UID: \"783b7dcf-6c7c-433b-b871-7e1cac52f565\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:38.132280 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:38.132198 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:38.275756 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:38.275729 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m"] Jul 24 14:41:38.279110 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:41:38.279079 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod783b7dcf_6c7c_433b_b871_7e1cac52f565.slice/crio-a2471b0864372148763e1673d004961aa8f3a0db78eac21a22a0818aec047562 WatchSource:0}: Error finding container a2471b0864372148763e1673d004961aa8f3a0db78eac21a22a0818aec047562: Status 404 returned error can't find the container with id a2471b0864372148763e1673d004961aa8f3a0db78eac21a22a0818aec047562 Jul 24 14:41:38.972734 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:38.972695 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" event={"ID":"783b7dcf-6c7c-433b-b871-7e1cac52f565","Type":"ContainerStarted","Data":"a2471b0864372148763e1673d004961aa8f3a0db78eac21a22a0818aec047562"} Jul 24 14:41:40.983258 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:40.983220 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" event={"ID":"783b7dcf-6c7c-433b-b871-7e1cac52f565","Type":"ContainerStarted","Data":"943ee315fc98210c7212211aac0701e1da8bc2eda5400f1c4886dac9920b8a47"} Jul 24 14:41:41.005095 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:41.005042 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" podStartSLOduration=2.262793742 podStartE2EDuration="4.005025443s" totalImagesPullingTime="1.742231701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:41:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:41:41.003029556 +0000 UTC m=+596.559945448" watchObservedRunningTime="2026-07-24 14:41:41.005025443 +0000 UTC m=+596.561941335" Jul 24 14:41:44.899890 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:44.899860 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 14:41:44.901383 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:44.901362 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 14:41:44.906911 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:44.906889 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 14:41:44.908415 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:44.908396 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 14:41:48.132900 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:48.132854 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:48.133304 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:48.132926 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:48.145520 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:48.145494 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:41:49.033175 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:41:49.033145 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m" Jul 24 14:43:41.694000 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:41.693923 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f4f559458-cbpbh"] Jul 24 14:43:41.696430 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:41.696411 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f4f559458-cbpbh" Jul 24 14:43:41.705964 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:41.705934 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f4f559458-cbpbh"] Jul 24 14:43:41.777992 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:41.777957 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld2nr\" (UniqueName: \"kubernetes.io/projected/f3723dc8-d99f-40f3-93e4-b46ff24c37e3-kube-api-access-ld2nr\") pod \"authorino-f4f559458-cbpbh\" (UID: \"f3723dc8-d99f-40f3-93e4-b46ff24c37e3\") " pod="kuadrant-system/authorino-f4f559458-cbpbh" Jul 24 14:43:41.778160 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:41.778074 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f3723dc8-d99f-40f3-93e4-b46ff24c37e3-tls-cert\") pod \"authorino-f4f559458-cbpbh\" (UID: \"f3723dc8-d99f-40f3-93e4-b46ff24c37e3\") " pod="kuadrant-system/authorino-f4f559458-cbpbh" Jul 24 14:43:41.879343 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:41.879307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld2nr\" (UniqueName: \"kubernetes.io/projected/f3723dc8-d99f-40f3-93e4-b46ff24c37e3-kube-api-access-ld2nr\") pod \"authorino-f4f559458-cbpbh\" (UID: \"f3723dc8-d99f-40f3-93e4-b46ff24c37e3\") " pod="kuadrant-system/authorino-f4f559458-cbpbh" Jul 24 14:43:41.879523 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:41.879421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f3723dc8-d99f-40f3-93e4-b46ff24c37e3-tls-cert\") pod \"authorino-f4f559458-cbpbh\" (UID: \"f3723dc8-d99f-40f3-93e4-b46ff24c37e3\") " pod="kuadrant-system/authorino-f4f559458-cbpbh" Jul 24 14:43:41.881843 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:41.881821 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f3723dc8-d99f-40f3-93e4-b46ff24c37e3-tls-cert\") pod \"authorino-f4f559458-cbpbh\" (UID: \"f3723dc8-d99f-40f3-93e4-b46ff24c37e3\") " pod="kuadrant-system/authorino-f4f559458-cbpbh" Jul 24 14:43:41.887022 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:41.886993 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld2nr\" (UniqueName: \"kubernetes.io/projected/f3723dc8-d99f-40f3-93e4-b46ff24c37e3-kube-api-access-ld2nr\") pod \"authorino-f4f559458-cbpbh\" (UID: \"f3723dc8-d99f-40f3-93e4-b46ff24c37e3\") " pod="kuadrant-system/authorino-f4f559458-cbpbh" Jul 24 14:43:42.006007 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:42.005932 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f4f559458-cbpbh" Jul 24 14:43:42.138673 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:42.138642 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f4f559458-cbpbh"] Jul 24 14:43:42.140894 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:43:42.140868 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3723dc8_d99f_40f3_93e4_b46ff24c37e3.slice/crio-0fe8bea95b10b9404d0b0f9f3a4b047b511d7456ed7dfa0376d997708ba1658a WatchSource:0}: Error finding container 0fe8bea95b10b9404d0b0f9f3a4b047b511d7456ed7dfa0376d997708ba1658a: Status 404 returned error can't find the container with id 0fe8bea95b10b9404d0b0f9f3a4b047b511d7456ed7dfa0376d997708ba1658a Jul 24 14:43:42.142116 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:42.142096 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 14:43:42.617280 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:42.617245 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f4f559458-cbpbh" event={"ID":"f3723dc8-d99f-40f3-93e4-b46ff24c37e3","Type":"ContainerStarted","Data":"8e4b6f00a6e9c291e14ff6d9ac7de17d2532af129132fd0f9bb3ca16790bbfca"} Jul 24 14:43:42.617434 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:42.617293 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f4f559458-cbpbh" event={"ID":"f3723dc8-d99f-40f3-93e4-b46ff24c37e3","Type":"ContainerStarted","Data":"0fe8bea95b10b9404d0b0f9f3a4b047b511d7456ed7dfa0376d997708ba1658a"} Jul 24 14:43:42.637249 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:42.637181 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f4f559458-cbpbh" podStartSLOduration=1.264142951 podStartE2EDuration="1.637158539s" totalImagesPullingTime="373.015588ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:43:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:43:42.634470787 +0000 UTC m=+718.191386679" watchObservedRunningTime="2026-07-24 14:43:42.637158539 +0000 UTC m=+718.194074433" Jul 24 14:43:42.667848 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:42.667782 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f8b77647-f7p82"] Jul 24 14:43:42.668129 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:42.668097 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7f8b77647-f7p82" podUID="4167ddfd-e3f6-4504-b707-41651f4b526f" containerName="authorino" containerID="cri-o://767118bbba6d9b0c0bb23634affa00085fe05f7fabc87b1b91fda8c0bac21e96" gracePeriod=30 Jul 24 14:43:42.929313 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:42.929284 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f8b77647-f7p82" Jul 24 14:43:42.988836 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:42.988807 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4167ddfd-e3f6-4504-b707-41651f4b526f-tls-cert\") pod \"4167ddfd-e3f6-4504-b707-41651f4b526f\" (UID: \"4167ddfd-e3f6-4504-b707-41651f4b526f\") " Jul 24 14:43:42.989028 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:42.988855 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ls8v\" (UniqueName: \"kubernetes.io/projected/4167ddfd-e3f6-4504-b707-41651f4b526f-kube-api-access-9ls8v\") pod \"4167ddfd-e3f6-4504-b707-41651f4b526f\" (UID: \"4167ddfd-e3f6-4504-b707-41651f4b526f\") " Jul 24 14:43:42.990906 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:42.990868 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4167ddfd-e3f6-4504-b707-41651f4b526f-kube-api-access-9ls8v" (OuterVolumeSpecName: "kube-api-access-9ls8v") pod "4167ddfd-e3f6-4504-b707-41651f4b526f" (UID: "4167ddfd-e3f6-4504-b707-41651f4b526f"). InnerVolumeSpecName "kube-api-access-9ls8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:43:43.002888 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:43.002852 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4167ddfd-e3f6-4504-b707-41651f4b526f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4167ddfd-e3f6-4504-b707-41651f4b526f" (UID: "4167ddfd-e3f6-4504-b707-41651f4b526f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:43:43.091337 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:43.090468 2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4167ddfd-e3f6-4504-b707-41651f4b526f-tls-cert\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:43:43.091337 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:43.090504 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ls8v\" (UniqueName: \"kubernetes.io/projected/4167ddfd-e3f6-4504-b707-41651f4b526f-kube-api-access-9ls8v\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:43:43.624937 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:43.624897 2581 generic.go:356] "Generic (PLEG): container finished" podID="4167ddfd-e3f6-4504-b707-41651f4b526f" containerID="767118bbba6d9b0c0bb23634affa00085fe05f7fabc87b1b91fda8c0bac21e96" exitCode=0 Jul 24 14:43:43.624937 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:43.624931 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f8b77647-f7p82" Jul 24 14:43:43.625142 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:43.624978 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f8b77647-f7p82" event={"ID":"4167ddfd-e3f6-4504-b707-41651f4b526f","Type":"ContainerDied","Data":"767118bbba6d9b0c0bb23634affa00085fe05f7fabc87b1b91fda8c0bac21e96"} Jul 24 14:43:43.625142 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:43.625037 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f8b77647-f7p82" event={"ID":"4167ddfd-e3f6-4504-b707-41651f4b526f","Type":"ContainerDied","Data":"97cebfeda51182b711eff6f1a3e249dfe4ff1eba70aaab046833f39689ab8fde"} Jul 24 14:43:43.625142 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:43.625079 2581 scope.go:117] "RemoveContainer" containerID="767118bbba6d9b0c0bb23634affa00085fe05f7fabc87b1b91fda8c0bac21e96" Jul 24 14:43:43.634991 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:43.634968 2581 scope.go:117] "RemoveContainer" containerID="767118bbba6d9b0c0bb23634affa00085fe05f7fabc87b1b91fda8c0bac21e96" Jul 24 14:43:43.635319 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:43:43.635294 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"767118bbba6d9b0c0bb23634affa00085fe05f7fabc87b1b91fda8c0bac21e96\": container with ID starting with 767118bbba6d9b0c0bb23634affa00085fe05f7fabc87b1b91fda8c0bac21e96 not found: ID does not exist" containerID="767118bbba6d9b0c0bb23634affa00085fe05f7fabc87b1b91fda8c0bac21e96" Jul 24 14:43:43.635366 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:43.635326 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"767118bbba6d9b0c0bb23634affa00085fe05f7fabc87b1b91fda8c0bac21e96"} err="failed to get container status \"767118bbba6d9b0c0bb23634affa00085fe05f7fabc87b1b91fda8c0bac21e96\": rpc error: code = NotFound desc = could not find container \"767118bbba6d9b0c0bb23634affa00085fe05f7fabc87b1b91fda8c0bac21e96\": container with ID starting with 767118bbba6d9b0c0bb23634affa00085fe05f7fabc87b1b91fda8c0bac21e96 not found: ID does not exist" Jul 24 14:43:43.655052 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:43.655014 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f8b77647-f7p82"] Jul 24 14:43:43.660061 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:43.660019 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f8b77647-f7p82"] Jul 24 14:43:44.972706 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:43:44.972675 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4167ddfd-e3f6-4504-b707-41651f4b526f" path="/var/lib/kubelet/pods/4167ddfd-e3f6-4504-b707-41651f4b526f/volumes" Jul 24 14:45:00.147542 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:45:00.147505 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748405-ld5zf"] Jul 24 14:45:00.148114 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:45:00.148096 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4167ddfd-e3f6-4504-b707-41651f4b526f" containerName="authorino" Jul 24 14:45:00.148159 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:45:00.148116 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4167ddfd-e3f6-4504-b707-41651f4b526f" containerName="authorino" Jul 24 14:45:00.148208 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:45:00.148200 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4167ddfd-e3f6-4504-b707-41651f4b526f" containerName="authorino" Jul 24 14:45:00.151268 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:45:00.151252 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748405-ld5zf" Jul 24 14:45:00.153886 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:45:00.153863 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8zr8n\"" Jul 24 14:45:00.162081 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:45:00.162055 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748405-ld5zf"] Jul 24 14:45:00.162220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:45:00.162152 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748405-ld5zf" Jul 24 14:45:00.302957 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:45:00.302929 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748405-ld5zf"] Jul 24 14:45:00.305057 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:45:00.305029 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09cfcbba_b5ba_4d54_bfbc_fdb6a0f7b56b.slice/crio-84640783f36cc14ab98ed09a5ac53087e99109d598128babe6cae793f3d2cb7d WatchSource:0}: Error finding container 84640783f36cc14ab98ed09a5ac53087e99109d598128babe6cae793f3d2cb7d: Status 404 returned error can't find the container with id 84640783f36cc14ab98ed09a5ac53087e99109d598128babe6cae793f3d2cb7d Jul 24 14:45:01.019938 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:45:01.019906 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748405-ld5zf" event={"ID":"09cfcbba-b5ba-4d54-bfbc-fdb6a0f7b56b","Type":"ContainerStarted","Data":"84640783f36cc14ab98ed09a5ac53087e99109d598128babe6cae793f3d2cb7d"} Jul 24 14:45:04.036242 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:45:04.036206 2581 generic.go:356] "Generic (PLEG): container finished" podID="09cfcbba-b5ba-4d54-bfbc-fdb6a0f7b56b" containerID="666b7e4106d9eed02ed5bdfeda7168b80dafd2ff2ffcf2702726f2e51cdf1679" exitCode=0 Jul 24 14:45:04.036686 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:45:04.036297 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748405-ld5zf" event={"ID":"09cfcbba-b5ba-4d54-bfbc-fdb6a0f7b56b","Type":"ContainerDied","Data":"666b7e4106d9eed02ed5bdfeda7168b80dafd2ff2ffcf2702726f2e51cdf1679"} Jul 24 14:45:05.182463 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:45:05.182434 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748405-ld5zf" Jul 24 14:45:06.048231 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:45:06.048191 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748405-ld5zf" event={"ID":"09cfcbba-b5ba-4d54-bfbc-fdb6a0f7b56b","Type":"ContainerDied","Data":"84640783f36cc14ab98ed09a5ac53087e99109d598128babe6cae793f3d2cb7d"} Jul 24 14:45:06.048550 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:45:06.048251 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84640783f36cc14ab98ed09a5ac53087e99109d598128babe6cae793f3d2cb7d" Jul 24 14:45:06.048550 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:45:06.048206 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748405-ld5zf" Jul 24 14:46:44.933275 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:46:44.933190 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 14:46:44.939348 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:46:44.939309 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 14:46:44.946654 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:46:44.946630 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 14:46:44.948908 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:46:44.948887 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 14:50:31.161951 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:31.161913 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj"] Jul 24 14:50:31.162656 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:31.162176 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" podUID="fd130668-1b70-421d-bbc0-3de678952be4" containerName="manager" containerID="cri-o://40e4256408377ce8ce58c91f584fac5eba211eb523e1722d263265f32c448d03" gracePeriod=10 Jul 24 14:50:34.754193 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:34.754149 2581 generic.go:356] "Generic (PLEG): container finished" podID="fd130668-1b70-421d-bbc0-3de678952be4" containerID="40e4256408377ce8ce58c91f584fac5eba211eb523e1722d263265f32c448d03" exitCode=0 Jul 24 14:50:34.754652 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:34.754239 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" event={"ID":"fd130668-1b70-421d-bbc0-3de678952be4","Type":"ContainerDied","Data":"40e4256408377ce8ce58c91f584fac5eba211eb523e1722d263265f32c448d03"} Jul 24 14:50:34.825074 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:34.825049 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" Jul 24 14:50:34.985615 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:34.985521 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rsct\" (UniqueName: \"kubernetes.io/projected/fd130668-1b70-421d-bbc0-3de678952be4-kube-api-access-8rsct\") pod \"fd130668-1b70-421d-bbc0-3de678952be4\" (UID: \"fd130668-1b70-421d-bbc0-3de678952be4\") " Jul 24 14:50:34.985615 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:34.985583 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd130668-1b70-421d-bbc0-3de678952be4-extensions-socket-volume\") pod \"fd130668-1b70-421d-bbc0-3de678952be4\" (UID: \"fd130668-1b70-421d-bbc0-3de678952be4\") " Jul 24 14:50:34.985972 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:34.985951 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd130668-1b70-421d-bbc0-3de678952be4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fd130668-1b70-421d-bbc0-3de678952be4" (UID: "fd130668-1b70-421d-bbc0-3de678952be4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:50:34.987624 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:34.987603 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd130668-1b70-421d-bbc0-3de678952be4-kube-api-access-8rsct" (OuterVolumeSpecName: "kube-api-access-8rsct") pod "fd130668-1b70-421d-bbc0-3de678952be4" (UID: "fd130668-1b70-421d-bbc0-3de678952be4"). InnerVolumeSpecName "kube-api-access-8rsct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:50:35.086938 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:35.086904 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rsct\" (UniqueName: \"kubernetes.io/projected/fd130668-1b70-421d-bbc0-3de678952be4-kube-api-access-8rsct\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:50:35.086938 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:35.086932 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd130668-1b70-421d-bbc0-3de678952be4-extensions-socket-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:50:35.761212 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:35.761172 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" event={"ID":"fd130668-1b70-421d-bbc0-3de678952be4","Type":"ContainerDied","Data":"ae2b1502034595b08056295c114d7ec3fcf1c9863ecea99f41e02159b02f0c25"} Jul 24 14:50:35.761212 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:35.761205 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj" Jul 24 14:50:35.761704 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:35.761251 2581 scope.go:117] "RemoveContainer" containerID="40e4256408377ce8ce58c91f584fac5eba211eb523e1722d263265f32c448d03" Jul 24 14:50:35.785555 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:35.785513 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj"] Jul 24 14:50:35.790551 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:35.790511 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j6bgj"] Jul 24 14:50:36.972551 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:50:36.972500 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd130668-1b70-421d-bbc0-3de678952be4" path="/var/lib/kubelet/pods/fd130668-1b70-421d-bbc0-3de678952be4/volumes" Jul 24 14:51:32.302046 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.302012 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ftbb"] Jul 24 14:51:32.304472 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.302418 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09cfcbba-b5ba-4d54-bfbc-fdb6a0f7b56b" containerName="cleanup" Jul 24 14:51:32.304472 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.302432 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="09cfcbba-b5ba-4d54-bfbc-fdb6a0f7b56b" containerName="cleanup" Jul 24 14:51:32.304472 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.302459 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd130668-1b70-421d-bbc0-3de678952be4" containerName="manager" Jul 24 14:51:32.304472 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.302466 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd130668-1b70-421d-bbc0-3de678952be4" containerName="manager" Jul 24 14:51:32.304472 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.302549 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd130668-1b70-421d-bbc0-3de678952be4" containerName="manager" Jul 24 14:51:32.304472 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.302561 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="09cfcbba-b5ba-4d54-bfbc-fdb6a0f7b56b" containerName="cleanup" Jul 24 14:51:32.305474 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.305457 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ftbb" Jul 24 14:51:32.308338 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.308315 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vqfmz\"" Jul 24 14:51:32.321468 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.321442 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ftbb"] Jul 24 14:51:32.391026 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.390986 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r2cv\" (UniqueName: \"kubernetes.io/projected/5e4595ab-da83-460e-b387-439b508f201f-kube-api-access-4r2cv\") pod \"kuadrant-operator-controller-manager-86878c769f-8ftbb\" (UID: \"5e4595ab-da83-460e-b387-439b508f201f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ftbb" Jul 24 14:51:32.391194 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.391092 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e4595ab-da83-460e-b387-439b508f201f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8ftbb\" (UID: \"5e4595ab-da83-460e-b387-439b508f201f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ftbb" Jul 24 14:51:32.492015 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.491977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r2cv\" (UniqueName: \"kubernetes.io/projected/5e4595ab-da83-460e-b387-439b508f201f-kube-api-access-4r2cv\") pod \"kuadrant-operator-controller-manager-86878c769f-8ftbb\" (UID: \"5e4595ab-da83-460e-b387-439b508f201f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ftbb" Jul 24 14:51:32.492210 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.492076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e4595ab-da83-460e-b387-439b508f201f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8ftbb\" (UID: \"5e4595ab-da83-460e-b387-439b508f201f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ftbb" Jul 24 14:51:32.492438 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.492419 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e4595ab-da83-460e-b387-439b508f201f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8ftbb\" (UID: \"5e4595ab-da83-460e-b387-439b508f201f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ftbb" Jul 24 14:51:32.503978 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.503948 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r2cv\" (UniqueName: \"kubernetes.io/projected/5e4595ab-da83-460e-b387-439b508f201f-kube-api-access-4r2cv\") pod \"kuadrant-operator-controller-manager-86878c769f-8ftbb\" (UID: \"5e4595ab-da83-460e-b387-439b508f201f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ftbb" Jul 24 14:51:32.615428 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.615338 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ftbb" Jul 24 14:51:32.755558 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:32.755518 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ftbb"] Jul 24 14:51:32.757736 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:51:32.757711 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e4595ab_da83_460e_b387_439b508f201f.slice/crio-68ea38e3467ce1df8c184c3ad429694581f5fe4dd21494bb1bbedf1f88b2f80c WatchSource:0}: Error finding container 68ea38e3467ce1df8c184c3ad429694581f5fe4dd21494bb1bbedf1f88b2f80c: Status 404 returned error can't find the container with id 68ea38e3467ce1df8c184c3ad429694581f5fe4dd21494bb1bbedf1f88b2f80c Jul 24 14:51:33.054974 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:33.054935 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ftbb" event={"ID":"5e4595ab-da83-460e-b387-439b508f201f","Type":"ContainerStarted","Data":"c9978e011113f5a91e6e48c4377d2438d358c29b28df599786347ead101743ab"} Jul 24 14:51:33.055203 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:33.055027 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ftbb" event={"ID":"5e4595ab-da83-460e-b387-439b508f201f","Type":"ContainerStarted","Data":"68ea38e3467ce1df8c184c3ad429694581f5fe4dd21494bb1bbedf1f88b2f80c"} Jul 24 14:51:33.055203 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:33.055180 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ftbb" Jul 24 14:51:33.079852 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:33.079796 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ftbb" podStartSLOduration=1.079775946 podStartE2EDuration="1.079775946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:51:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:51:33.077041772 +0000 UTC m=+1188.633957663" watchObservedRunningTime="2026-07-24 14:51:33.079775946 +0000 UTC m=+1188.636691839" Jul 24 14:51:44.062184 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:44.062148 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ftbb" Jul 24 14:51:44.972711 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:44.972678 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 14:51:44.974608 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:44.974583 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 14:51:44.980099 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:44.980066 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 14:51:44.981792 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:51:44.981775 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 14:56:45.002233 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:56:45.002205 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 14:56:45.004776 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:56:45.004633 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 14:56:45.009651 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:56:45.009626 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 14:56:45.011804 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:56:45.011784 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 14:58:35.896762 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:35.896732 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5"] Jul 24 14:58:35.900273 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:35.900256 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:35.903378 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:35.903353 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-639b4a8c-openshift-default-dockercfg-w7wcl\"" Jul 24 14:58:35.922128 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:35.922103 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5"] Jul 24 14:58:35.953347 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:35.953314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-workload-socket\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:35.953494 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:35.953363 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-envoy\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:35.953494 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:35.953382 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-podinfo\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:35.953615 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:35.953495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istiod-ca-cert\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:35.953615 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:35.953563 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-token\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:35.953701 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:35.953625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-credential-socket\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:35.953701 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:35.953661 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-workload-certs\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:35.953701 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:35.953692 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvkrh\" (UniqueName: \"kubernetes.io/projected/835f68ba-dac2-4cbf-95e6-6beb151b45e7-kube-api-access-jvkrh\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:35.953848 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:35.953737 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-data\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.054845 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.054805 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-envoy\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.055033 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.054852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-podinfo\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.055033 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.054900 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istiod-ca-cert\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.055597 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.055560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-token\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.055735 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.055618 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-credential-socket\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.055735 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.055656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-workload-certs\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.055735 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.055705 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvkrh\" (UniqueName: \"kubernetes.io/projected/835f68ba-dac2-4cbf-95e6-6beb151b45e7-kube-api-access-jvkrh\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.055910 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.055750 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istiod-ca-cert\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.055910 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.055762 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-data\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.055910 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.055862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-workload-socket\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.056071 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.055981 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-credential-socket\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.056071 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.056020 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-data\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.056195 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.056173 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-workload-socket\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.056251 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.056241 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-workload-certs\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.057470 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.057440 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-envoy\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.058345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.058317 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-podinfo\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.064719 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.064694 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvkrh\" (UniqueName: \"kubernetes.io/projected/835f68ba-dac2-4cbf-95e6-6beb151b45e7-kube-api-access-jvkrh\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.064853 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.064747 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-token\") pod \"e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.212220 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.212138 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:36.356606 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.356579 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5"] Jul 24 14:58:36.358882 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:58:36.358853 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod835f68ba_dac2_4cbf_95e6_6beb151b45e7.slice/crio-8aa98c1138f446d87e0453712930e4fe9a30ea59e3e74d8757b1c398482892e7 WatchSource:0}: Error finding container 8aa98c1138f446d87e0453712930e4fe9a30ea59e3e74d8757b1c398482892e7: Status 404 returned error can't find the container with id 8aa98c1138f446d87e0453712930e4fe9a30ea59e3e74d8757b1c398482892e7 Jul 24 14:58:36.360957 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.360923 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:58:36.361024 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.360992 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:58:36.361063 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:36.361022 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:58:37.254577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:37.254467 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" event={"ID":"835f68ba-dac2-4cbf-95e6-6beb151b45e7","Type":"ContainerStarted","Data":"a767cdd97799fe1dee0e59ba8dac8af6ae6350db8239e29cdd650d0bc07da333"} Jul 24 14:58:37.254577 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:37.254523 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" event={"ID":"835f68ba-dac2-4cbf-95e6-6beb151b45e7","Type":"ContainerStarted","Data":"8aa98c1138f446d87e0453712930e4fe9a30ea59e3e74d8757b1c398482892e7"} Jul 24 14:58:37.280085 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:37.280018 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" podStartSLOduration=2.2800032310000002 podStartE2EDuration="2.280003231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:58:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:58:37.278274254 +0000 UTC m=+1612.835190159" watchObservedRunningTime="2026-07-24 14:58:37.280003231 +0000 UTC m=+1612.836919123" Jul 24 14:58:38.212621 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:38.212583 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:38.217524 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:38.217499 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:38.260955 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:38.260920 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:38.261940 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:38.261920 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:39.467768 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.467733 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5"] Jul 24 14:58:39.471492 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.471474 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" Jul 24 14:58:39.474052 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.474031 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-639b4a8c\"" Jul 24 14:58:39.474181 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.474100 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-639b4a8c-dockercfg-2kh8p\"" Jul 24 14:58:39.482344 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.482322 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5"] Jul 24 14:58:39.495210 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.495181 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns"] Jul 24 14:58:39.498855 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.498835 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" Jul 24 14:58:39.508667 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.508638 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns"] Jul 24 14:58:39.592011 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.591976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdg88\" (UniqueName: \"kubernetes.io/projected/2c8f7577-82b5-4d54-b7ed-15917cbc100e-kube-api-access-hdg88\") pod \"payload-processing-e2e-ait-639b4a8c-788986df4d-544w5\" (UID: \"2c8f7577-82b5-4d54-b7ed-15917cbc100e\") " pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" Jul 24 14:58:39.592178 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.592031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97799\" (UniqueName: \"kubernetes.io/projected/dbe70191-09ee-4264-a780-15f5219c5ad0-kube-api-access-97799\") pod \"payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns\" (UID: \"dbe70191-09ee-4264-a780-15f5219c5ad0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" Jul 24 14:58:39.592178 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.592050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c8f7577-82b5-4d54-b7ed-15917cbc100e-plugins-config-volume\") pod \"payload-processing-e2e-ait-639b4a8c-788986df4d-544w5\" (UID: \"2c8f7577-82b5-4d54-b7ed-15917cbc100e\") " pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" Jul 24 14:58:39.592178 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.592103 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbe70191-09ee-4264-a780-15f5219c5ad0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns\" (UID: \"dbe70191-09ee-4264-a780-15f5219c5ad0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" Jul 24 14:58:39.693350 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.693312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdg88\" (UniqueName: \"kubernetes.io/projected/2c8f7577-82b5-4d54-b7ed-15917cbc100e-kube-api-access-hdg88\") pod \"payload-processing-e2e-ait-639b4a8c-788986df4d-544w5\" (UID: \"2c8f7577-82b5-4d54-b7ed-15917cbc100e\") " pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" Jul 24 14:58:39.693561 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.693368 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97799\" (UniqueName: \"kubernetes.io/projected/dbe70191-09ee-4264-a780-15f5219c5ad0-kube-api-access-97799\") pod \"payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns\" (UID: \"dbe70191-09ee-4264-a780-15f5219c5ad0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" Jul 24 14:58:39.693561 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.693396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c8f7577-82b5-4d54-b7ed-15917cbc100e-plugins-config-volume\") pod \"payload-processing-e2e-ait-639b4a8c-788986df4d-544w5\" (UID: \"2c8f7577-82b5-4d54-b7ed-15917cbc100e\") " pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" Jul 24 14:58:39.693561 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.693421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbe70191-09ee-4264-a780-15f5219c5ad0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns\" (UID: \"dbe70191-09ee-4264-a780-15f5219c5ad0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" Jul 24 14:58:39.694227 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.694208 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c8f7577-82b5-4d54-b7ed-15917cbc100e-plugins-config-volume\") pod \"payload-processing-e2e-ait-639b4a8c-788986df4d-544w5\" (UID: \"2c8f7577-82b5-4d54-b7ed-15917cbc100e\") " pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" Jul 24 14:58:39.694264 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.694208 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbe70191-09ee-4264-a780-15f5219c5ad0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns\" (UID: \"dbe70191-09ee-4264-a780-15f5219c5ad0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" Jul 24 14:58:39.706216 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.706179 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdg88\" (UniqueName: \"kubernetes.io/projected/2c8f7577-82b5-4d54-b7ed-15917cbc100e-kube-api-access-hdg88\") pod \"payload-processing-e2e-ait-639b4a8c-788986df4d-544w5\" (UID: \"2c8f7577-82b5-4d54-b7ed-15917cbc100e\") " pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" Jul 24 14:58:39.706349 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.706285 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97799\" (UniqueName: \"kubernetes.io/projected/dbe70191-09ee-4264-a780-15f5219c5ad0-kube-api-access-97799\") pod \"payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns\" (UID: \"dbe70191-09ee-4264-a780-15f5219c5ad0\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" Jul 24 14:58:39.783214 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.783184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" Jul 24 14:58:39.810095 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.810067 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" Jul 24 14:58:39.941380 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.941284 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5"] Jul 24 14:58:39.943123 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:58:39.943090 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c8f7577_82b5_4d54_b7ed_15917cbc100e.slice/crio-397aefc2b47659d40752f98576066515ccbb69339d1ca7840af43f7ee7d7f328 WatchSource:0}: Error finding container 397aefc2b47659d40752f98576066515ccbb69339d1ca7840af43f7ee7d7f328: Status 404 returned error can't find the container with id 397aefc2b47659d40752f98576066515ccbb69339d1ca7840af43f7ee7d7f328 Jul 24 14:58:39.973507 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:39.973482 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns"] Jul 24 14:58:39.977622 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:58:39.977597 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe70191_09ee_4264_a780_15f5219c5ad0.slice/crio-c542c2758c40c730b84ec7a0542b8995ac8454184a3cd28b22dde21b945dee42 WatchSource:0}: Error finding container c542c2758c40c730b84ec7a0542b8995ac8454184a3cd28b22dde21b945dee42: Status 404 returned error can't find the container with id c542c2758c40c730b84ec7a0542b8995ac8454184a3cd28b22dde21b945dee42 Jul 24 14:58:40.272315 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:40.272225 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" event={"ID":"2c8f7577-82b5-4d54-b7ed-15917cbc100e","Type":"ContainerStarted","Data":"98db79dc24cc450774e92e2952c1f0f2e3638cc2a978563ca36bbdb1afc61fd4"} Jul 24 14:58:40.272315 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:40.272279 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" event={"ID":"2c8f7577-82b5-4d54-b7ed-15917cbc100e","Type":"ContainerStarted","Data":"397aefc2b47659d40752f98576066515ccbb69339d1ca7840af43f7ee7d7f328"} Jul 24 14:58:40.272569 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:40.272326 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" Jul 24 14:58:40.273980 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:40.273953 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" event={"ID":"dbe70191-09ee-4264-a780-15f5219c5ad0","Type":"ContainerStarted","Data":"2482321c999fc780027a8ada19304baad072ef4a42fcafabe9c0bfadd5263144"} Jul 24 14:58:40.274107 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:40.274007 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" event={"ID":"dbe70191-09ee-4264-a780-15f5219c5ad0","Type":"ContainerStarted","Data":"c542c2758c40c730b84ec7a0542b8995ac8454184a3cd28b22dde21b945dee42"} Jul 24 14:58:40.274107 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:40.274035 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" Jul 24 14:58:40.292835 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:40.292782 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" podStartSLOduration=1.29276661 podStartE2EDuration="1.29276661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:58:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:58:40.290741771 +0000 UTC m=+1615.847657663" watchObservedRunningTime="2026-07-24 14:58:40.29276661 +0000 UTC m=+1615.849682529" Jul 24 14:58:40.310993 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:40.310943 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" podStartSLOduration=1.310916041 podStartE2EDuration="1.310916041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:58:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:58:40.30948132 +0000 UTC m=+1615.866397218" watchObservedRunningTime="2026-07-24 14:58:40.310916041 +0000 UTC m=+1615.867831932" Jul 24 14:58:51.281724 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:51.281679 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" Jul 24 14:58:51.282138 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:51.281843 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" Jul 24 14:58:54.303688 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:54.303648 2581 patch_prober.go:28] interesting pod/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 24 14:58:54.304100 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:54.303725 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" podUID="835f68ba-dac2-4cbf-95e6-6beb151b45e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 24 14:58:55.357950 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:55.357917 2581 generic.go:356] "Generic (PLEG): container finished" podID="835f68ba-dac2-4cbf-95e6-6beb151b45e7" containerID="a767cdd97799fe1dee0e59ba8dac8af6ae6350db8239e29cdd650d0bc07da333" exitCode=0 Jul 24 14:58:55.358383 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:55.357992 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" event={"ID":"835f68ba-dac2-4cbf-95e6-6beb151b45e7","Type":"ContainerDied","Data":"a767cdd97799fe1dee0e59ba8dac8af6ae6350db8239e29cdd650d0bc07da333"} Jul 24 14:58:55.358431 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:55.358409 2581 scope.go:117] "RemoveContainer" containerID="a767cdd97799fe1dee0e59ba8dac8af6ae6350db8239e29cdd650d0bc07da333" Jul 24 14:58:55.359442 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:55.359414 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:58:55.359510 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:55.359486 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:58:55.359572 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:55.359514 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:58:56.369478 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:56.369429 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" event={"ID":"835f68ba-dac2-4cbf-95e6-6beb151b45e7","Type":"ContainerStarted","Data":"66b60d9c8fcc64ed6b53e3ae5e9265d4c334bdf5ac5e0905b4fa80482c93b854"} Jul 24 14:58:57.212346 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:57.212301 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:58:57.212583 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:57.212555 2581 patch_prober.go:28] interesting pod/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 24 14:58:57.212631 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:57.212612 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" podUID="835f68ba-dac2-4cbf-95e6-6beb151b45e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 24 14:58:58.213553 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:58.213494 2581 patch_prober.go:28] interesting pod/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 24 14:58:58.214142 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:58.213585 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" podUID="835f68ba-dac2-4cbf-95e6-6beb151b45e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 24 14:58:59.213341 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:59.213296 2581 patch_prober.go:28] interesting pod/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 24 14:58:59.213589 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:58:59.213362 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" podUID="835f68ba-dac2-4cbf-95e6-6beb151b45e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 24 14:59:00.255228 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:00.255196 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:59:00.255732 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:00.255558 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:59:00.256325 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:00.256307 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:59:14.763870 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:14.763835 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5"] Jul 24 14:59:14.764587 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:14.764059 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" podUID="2c8f7577-82b5-4d54-b7ed-15917cbc100e" containerName="payload-processing" containerID="cri-o://98db79dc24cc450774e92e2952c1f0f2e3638cc2a978563ca36bbdb1afc61fd4" gracePeriod=30 Jul 24 14:59:14.769510 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:14.769464 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns"] Jul 24 14:59:14.770058 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:14.769713 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" podUID="dbe70191-09ee-4264-a780-15f5219c5ad0" containerName="payload-pre-processing" containerID="cri-o://2482321c999fc780027a8ada19304baad072ef4a42fcafabe9c0bfadd5263144" gracePeriod=30 Jul 24 14:59:15.034804 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.034775 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" Jul 24 14:59:15.062739 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.062714 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" Jul 24 14:59:15.128453 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.128410 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdg88\" (UniqueName: \"kubernetes.io/projected/2c8f7577-82b5-4d54-b7ed-15917cbc100e-kube-api-access-hdg88\") pod \"2c8f7577-82b5-4d54-b7ed-15917cbc100e\" (UID: \"2c8f7577-82b5-4d54-b7ed-15917cbc100e\") " Jul 24 14:59:15.128682 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.128460 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbe70191-09ee-4264-a780-15f5219c5ad0-plugins-config-volume\") pod \"dbe70191-09ee-4264-a780-15f5219c5ad0\" (UID: \"dbe70191-09ee-4264-a780-15f5219c5ad0\") " Jul 24 14:59:15.128682 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.128499 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c8f7577-82b5-4d54-b7ed-15917cbc100e-plugins-config-volume\") pod \"2c8f7577-82b5-4d54-b7ed-15917cbc100e\" (UID: \"2c8f7577-82b5-4d54-b7ed-15917cbc100e\") " Jul 24 14:59:15.128682 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.128607 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97799\" (UniqueName: \"kubernetes.io/projected/dbe70191-09ee-4264-a780-15f5219c5ad0-kube-api-access-97799\") pod \"dbe70191-09ee-4264-a780-15f5219c5ad0\" (UID: \"dbe70191-09ee-4264-a780-15f5219c5ad0\") " Jul 24 14:59:15.128880 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.128853 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbe70191-09ee-4264-a780-15f5219c5ad0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dbe70191-09ee-4264-a780-15f5219c5ad0" (UID: "dbe70191-09ee-4264-a780-15f5219c5ad0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:59:15.128945 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.128880 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c8f7577-82b5-4d54-b7ed-15917cbc100e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2c8f7577-82b5-4d54-b7ed-15917cbc100e" (UID: "2c8f7577-82b5-4d54-b7ed-15917cbc100e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:59:15.130597 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.130573 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c8f7577-82b5-4d54-b7ed-15917cbc100e-kube-api-access-hdg88" (OuterVolumeSpecName: "kube-api-access-hdg88") pod "2c8f7577-82b5-4d54-b7ed-15917cbc100e" (UID: "2c8f7577-82b5-4d54-b7ed-15917cbc100e"). InnerVolumeSpecName "kube-api-access-hdg88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:59:15.130671 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.130655 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbe70191-09ee-4264-a780-15f5219c5ad0-kube-api-access-97799" (OuterVolumeSpecName: "kube-api-access-97799") pod "dbe70191-09ee-4264-a780-15f5219c5ad0" (UID: "dbe70191-09ee-4264-a780-15f5219c5ad0"). InnerVolumeSpecName "kube-api-access-97799". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:59:15.229773 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.229729 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97799\" (UniqueName: \"kubernetes.io/projected/dbe70191-09ee-4264-a780-15f5219c5ad0-kube-api-access-97799\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:59:15.229773 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.229767 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdg88\" (UniqueName: \"kubernetes.io/projected/2c8f7577-82b5-4d54-b7ed-15917cbc100e-kube-api-access-hdg88\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:59:15.229773 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.229777 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbe70191-09ee-4264-a780-15f5219c5ad0-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:59:15.229990 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.229786 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c8f7577-82b5-4d54-b7ed-15917cbc100e-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:59:15.468480 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.468437 2581 generic.go:356] "Generic (PLEG): container finished" podID="2c8f7577-82b5-4d54-b7ed-15917cbc100e" containerID="98db79dc24cc450774e92e2952c1f0f2e3638cc2a978563ca36bbdb1afc61fd4" exitCode=0 Jul 24 14:59:15.468675 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.468502 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" Jul 24 14:59:15.468675 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.468520 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" event={"ID":"2c8f7577-82b5-4d54-b7ed-15917cbc100e","Type":"ContainerDied","Data":"98db79dc24cc450774e92e2952c1f0f2e3638cc2a978563ca36bbdb1afc61fd4"} Jul 24 14:59:15.468675 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.468613 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5" event={"ID":"2c8f7577-82b5-4d54-b7ed-15917cbc100e","Type":"ContainerDied","Data":"397aefc2b47659d40752f98576066515ccbb69339d1ca7840af43f7ee7d7f328"} Jul 24 14:59:15.468675 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.468643 2581 scope.go:117] "RemoveContainer" containerID="98db79dc24cc450774e92e2952c1f0f2e3638cc2a978563ca36bbdb1afc61fd4" Jul 24 14:59:15.469835 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.469816 2581 generic.go:356] "Generic (PLEG): container finished" podID="dbe70191-09ee-4264-a780-15f5219c5ad0" containerID="2482321c999fc780027a8ada19304baad072ef4a42fcafabe9c0bfadd5263144" exitCode=0 Jul 24 14:59:15.469922 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.469858 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" event={"ID":"dbe70191-09ee-4264-a780-15f5219c5ad0","Type":"ContainerDied","Data":"2482321c999fc780027a8ada19304baad072ef4a42fcafabe9c0bfadd5263144"} Jul 24 14:59:15.469922 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.469870 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" Jul 24 14:59:15.470031 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.469902 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns" event={"ID":"dbe70191-09ee-4264-a780-15f5219c5ad0","Type":"ContainerDied","Data":"c542c2758c40c730b84ec7a0542b8995ac8454184a3cd28b22dde21b945dee42"} Jul 24 14:59:15.477420 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.477391 2581 scope.go:117] "RemoveContainer" containerID="98db79dc24cc450774e92e2952c1f0f2e3638cc2a978563ca36bbdb1afc61fd4" Jul 24 14:59:15.477992 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:59:15.477715 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98db79dc24cc450774e92e2952c1f0f2e3638cc2a978563ca36bbdb1afc61fd4\": container with ID starting with 98db79dc24cc450774e92e2952c1f0f2e3638cc2a978563ca36bbdb1afc61fd4 not found: ID does not exist" containerID="98db79dc24cc450774e92e2952c1f0f2e3638cc2a978563ca36bbdb1afc61fd4" Jul 24 14:59:15.477992 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.477740 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98db79dc24cc450774e92e2952c1f0f2e3638cc2a978563ca36bbdb1afc61fd4"} err="failed to get container status \"98db79dc24cc450774e92e2952c1f0f2e3638cc2a978563ca36bbdb1afc61fd4\": rpc error: code = NotFound desc = could not find container \"98db79dc24cc450774e92e2952c1f0f2e3638cc2a978563ca36bbdb1afc61fd4\": container with ID starting with 98db79dc24cc450774e92e2952c1f0f2e3638cc2a978563ca36bbdb1afc61fd4 not found: ID does not exist" Jul 24 14:59:15.477992 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.477756 2581 scope.go:117] "RemoveContainer" containerID="2482321c999fc780027a8ada19304baad072ef4a42fcafabe9c0bfadd5263144" Jul 24 14:59:15.486923 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.486902 2581 scope.go:117] "RemoveContainer" containerID="2482321c999fc780027a8ada19304baad072ef4a42fcafabe9c0bfadd5263144" Jul 24 14:59:15.487193 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:59:15.487175 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2482321c999fc780027a8ada19304baad072ef4a42fcafabe9c0bfadd5263144\": container with ID starting with 2482321c999fc780027a8ada19304baad072ef4a42fcafabe9c0bfadd5263144 not found: ID does not exist" containerID="2482321c999fc780027a8ada19304baad072ef4a42fcafabe9c0bfadd5263144" Jul 24 14:59:15.487265 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.487204 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2482321c999fc780027a8ada19304baad072ef4a42fcafabe9c0bfadd5263144"} err="failed to get container status \"2482321c999fc780027a8ada19304baad072ef4a42fcafabe9c0bfadd5263144\": rpc error: code = NotFound desc = could not find container \"2482321c999fc780027a8ada19304baad072ef4a42fcafabe9c0bfadd5263144\": container with ID starting with 2482321c999fc780027a8ada19304baad072ef4a42fcafabe9c0bfadd5263144 not found: ID does not exist" Jul 24 14:59:15.500865 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.500840 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5"] Jul 24 14:59:15.508946 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.508925 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-639b4a8c-788986df4d-544w5"] Jul 24 14:59:15.524464 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.524432 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns"] Jul 24 14:59:15.526733 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:15.526713 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-639b4a8c-74bff6468d-xzlns"] Jul 24 14:59:16.972584 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:16.972550 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c8f7577-82b5-4d54-b7ed-15917cbc100e" path="/var/lib/kubelet/pods/2c8f7577-82b5-4d54-b7ed-15917cbc100e/volumes" Jul 24 14:59:16.972970 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:16.972917 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbe70191-09ee-4264-a780-15f5219c5ad0" path="/var/lib/kubelet/pods/dbe70191-09ee-4264-a780-15f5219c5ad0/volumes" Jul 24 14:59:19.483083 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:19.483043 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5"] Jul 24 14:59:19.483618 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:19.483315 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" podUID="835f68ba-dac2-4cbf-95e6-6beb151b45e7" containerName="istio-proxy" containerID="cri-o://66b60d9c8fcc64ed6b53e3ae5e9265d4c334bdf5ac5e0905b4fa80482c93b854" gracePeriod=30 Jul 24 14:59:20.457539 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.457487 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh"] Jul 24 14:59:20.457994 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.457974 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c8f7577-82b5-4d54-b7ed-15917cbc100e" containerName="payload-processing" Jul 24 14:59:20.458087 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.457996 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c8f7577-82b5-4d54-b7ed-15917cbc100e" containerName="payload-processing" Jul 24 14:59:20.458087 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.458009 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe70191-09ee-4264-a780-15f5219c5ad0" containerName="payload-pre-processing" Jul 24 14:59:20.458087 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.458017 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe70191-09ee-4264-a780-15f5219c5ad0" containerName="payload-pre-processing" Jul 24 14:59:20.458243 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.458110 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c8f7577-82b5-4d54-b7ed-15917cbc100e" containerName="payload-processing" Jul 24 14:59:20.458243 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.458122 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbe70191-09ee-4264-a780-15f5219c5ad0" containerName="payload-pre-processing" Jul 24 14:59:20.461316 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.461295 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.463011 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.462986 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh"] Jul 24 14:59:20.463830 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.463812 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-5084c046-gw-openshift-default-dockercfg-pmmr5\"" Jul 24 14:59:20.579315 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.579279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1051066d-75d4-4979-99e8-038c10268fe7-istio-token\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.579730 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.579329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-workload-socket\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.579730 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.579430 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-credential-socket\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.579730 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.579464 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1051066d-75d4-4979-99e8-038c10268fe7-istiod-ca-cert\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.579730 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.579487 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqv2n\" (UniqueName: \"kubernetes.io/projected/1051066d-75d4-4979-99e8-038c10268fe7-kube-api-access-lqv2n\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.579730 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.579581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-istio-data\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.579730 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.579611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-istio-envoy\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.579730 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.579629 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1051066d-75d4-4979-99e8-038c10268fe7-istio-podinfo\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.579730 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.579652 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-workload-certs\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.681234 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.681190 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-istio-envoy\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.681387 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.681243 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1051066d-75d4-4979-99e8-038c10268fe7-istio-podinfo\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.681387 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.681276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-workload-certs\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.681387 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.681334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1051066d-75d4-4979-99e8-038c10268fe7-istio-token\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.681387 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.681377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-workload-socket\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.681640 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.681460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-credential-socket\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.681640 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.681486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1051066d-75d4-4979-99e8-038c10268fe7-istiod-ca-cert\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.681640 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.681520 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqv2n\" (UniqueName: \"kubernetes.io/projected/1051066d-75d4-4979-99e8-038c10268fe7-kube-api-access-lqv2n\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.681640 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.681593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-istio-data\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.681989 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.681867 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-credential-socket\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.681989 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.681928 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-workload-socket\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.681989 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.681953 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-istio-data\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.682198 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.682103 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-workload-certs\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.682319 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.682300 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1051066d-75d4-4979-99e8-038c10268fe7-istiod-ca-cert\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.684141 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.684119 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-istio-envoy\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.684272 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.684254 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1051066d-75d4-4979-99e8-038c10268fe7-istio-podinfo\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.690917 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.690891 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1051066d-75d4-4979-99e8-038c10268fe7-istio-token\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.691511 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.691491 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqv2n\" (UniqueName: \"kubernetes.io/projected/1051066d-75d4-4979-99e8-038c10268fe7-kube-api-access-lqv2n\") pod \"e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.773350 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.773255 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:20.920878 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.920779 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh"] Jul 24 14:59:20.923203 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:59:20.923176 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1051066d_75d4_4979_99e8_038c10268fe7.slice/crio-973c7a72b5465d6b44dff0eb85740aea35336dac70919fe78f4070ccd0d50b25 WatchSource:0}: Error finding container 973c7a72b5465d6b44dff0eb85740aea35336dac70919fe78f4070ccd0d50b25: Status 404 returned error can't find the container with id 973c7a72b5465d6b44dff0eb85740aea35336dac70919fe78f4070ccd0d50b25 Jul 24 14:59:20.925395 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.925365 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:59:20.925471 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.925428 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:59:20.925471 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:20.925457 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:59:21.505216 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:21.505174 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" event={"ID":"1051066d-75d4-4979-99e8-038c10268fe7","Type":"ContainerStarted","Data":"a1d48dae2a2699a5baa99bb64ca84b9cb7b8b48d5ce328c4fbf6a8d2378b2852"} Jul 24 14:59:21.505376 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:21.505244 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" event={"ID":"1051066d-75d4-4979-99e8-038c10268fe7","Type":"ContainerStarted","Data":"973c7a72b5465d6b44dff0eb85740aea35336dac70919fe78f4070ccd0d50b25"} Jul 24 14:59:21.525397 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:21.525345 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" podStartSLOduration=1.525328838 podStartE2EDuration="1.525328838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:59:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:59:21.524413149 +0000 UTC m=+1657.081329055" watchObservedRunningTime="2026-07-24 14:59:21.525328838 +0000 UTC m=+1657.082244730" Jul 24 14:59:21.773778 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:21.773689 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:21.778511 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:21.778488 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:22.510557 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:22.510499 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:22.511483 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:22.511462 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:24.332146 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.332110 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4"] Jul 24 14:59:24.335682 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.335664 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" Jul 24 14:59:24.338432 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.338405 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-5084c046\"" Jul 24 14:59:24.338573 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.338492 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-5084c046-dockercfg-6gl7x\"" Jul 24 14:59:24.351030 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.350997 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4"] Jul 24 14:59:24.419094 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.419063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efca6046-49f3-4890-ba1e-f448e24c8d04-plugins-config-volume\") pod \"payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4\" (UID: \"efca6046-49f3-4890-ba1e-f448e24c8d04\") " pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" Jul 24 14:59:24.419274 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.419119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l7lm\" (UniqueName: \"kubernetes.io/projected/efca6046-49f3-4890-ba1e-f448e24c8d04-kube-api-access-6l7lm\") pod \"payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4\" (UID: \"efca6046-49f3-4890-ba1e-f448e24c8d04\") " pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" Jul 24 14:59:24.520120 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.520096 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efca6046-49f3-4890-ba1e-f448e24c8d04-plugins-config-volume\") pod \"payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4\" (UID: \"efca6046-49f3-4890-ba1e-f448e24c8d04\") " pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" Jul 24 14:59:24.520243 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.520154 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l7lm\" (UniqueName: \"kubernetes.io/projected/efca6046-49f3-4890-ba1e-f448e24c8d04-kube-api-access-6l7lm\") pod \"payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4\" (UID: \"efca6046-49f3-4890-ba1e-f448e24c8d04\") " pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" Jul 24 14:59:24.520778 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.520760 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efca6046-49f3-4890-ba1e-f448e24c8d04-plugins-config-volume\") pod \"payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4\" (UID: \"efca6046-49f3-4890-ba1e-f448e24c8d04\") " pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" Jul 24 14:59:24.529359 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.529339 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l7lm\" (UniqueName: \"kubernetes.io/projected/efca6046-49f3-4890-ba1e-f448e24c8d04-kube-api-access-6l7lm\") pod \"payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4\" (UID: \"efca6046-49f3-4890-ba1e-f448e24c8d04\") " pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" Jul 24 14:59:24.647091 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.647054 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" Jul 24 14:59:24.770828 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.770799 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:59:24.818957 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.818930 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4"] Jul 24 14:59:24.821445 ip-10-0-142-64 kubenswrapper[2581]: W0724 14:59:24.821417 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefca6046_49f3_4890_ba1e_f448e24c8d04.slice/crio-f2a61d14e21e755d44ccf11e6f5be8289e74a1f213db633f7263812a396d7a18 WatchSource:0}: Error finding container f2a61d14e21e755d44ccf11e6f5be8289e74a1f213db633f7263812a396d7a18: Status 404 returned error can't find the container with id f2a61d14e21e755d44ccf11e6f5be8289e74a1f213db633f7263812a396d7a18 Jul 24 14:59:24.923841 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.923810 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-data\") pod \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " Jul 24 14:59:24.924020 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.923860 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-token\") pod \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " Jul 24 14:59:24.924020 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.923890 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-workload-socket\") pod \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " Jul 24 14:59:24.924020 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.923910 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-podinfo\") pod \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " Jul 24 14:59:24.924020 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.923930 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istiod-ca-cert\") pod \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " Jul 24 14:59:24.924020 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.923948 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvkrh\" (UniqueName: \"kubernetes.io/projected/835f68ba-dac2-4cbf-95e6-6beb151b45e7-kube-api-access-jvkrh\") pod \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " Jul 24 14:59:24.924020 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.924006 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-credential-socket\") pod \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " Jul 24 14:59:24.924345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.924049 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-envoy\") pod \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " Jul 24 14:59:24.924345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.924124 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-workload-certs\") pod \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\" (UID: \"835f68ba-dac2-4cbf-95e6-6beb151b45e7\") " Jul 24 14:59:24.924345 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.924200 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "835f68ba-dac2-4cbf-95e6-6beb151b45e7" (UID: "835f68ba-dac2-4cbf-95e6-6beb151b45e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:59:24.924490 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.924375 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "835f68ba-dac2-4cbf-95e6-6beb151b45e7" (UID: "835f68ba-dac2-4cbf-95e6-6beb151b45e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:59:24.924490 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.924463 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-workload-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:59:24.924490 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.924483 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-workload-certs\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:59:24.924739 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.924547 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "835f68ba-dac2-4cbf-95e6-6beb151b45e7" (UID: "835f68ba-dac2-4cbf-95e6-6beb151b45e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:59:24.924877 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.924848 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "835f68ba-dac2-4cbf-95e6-6beb151b45e7" (UID: "835f68ba-dac2-4cbf-95e6-6beb151b45e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:59:24.924998 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.924957 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "835f68ba-dac2-4cbf-95e6-6beb151b45e7" (UID: "835f68ba-dac2-4cbf-95e6-6beb151b45e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:59:24.926232 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.926211 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "835f68ba-dac2-4cbf-95e6-6beb151b45e7" (UID: "835f68ba-dac2-4cbf-95e6-6beb151b45e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:59:24.926399 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.926380 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/835f68ba-dac2-4cbf-95e6-6beb151b45e7-kube-api-access-jvkrh" (OuterVolumeSpecName: "kube-api-access-jvkrh") pod "835f68ba-dac2-4cbf-95e6-6beb151b45e7" (UID: "835f68ba-dac2-4cbf-95e6-6beb151b45e7"). InnerVolumeSpecName "kube-api-access-jvkrh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:59:24.926630 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.926608 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "835f68ba-dac2-4cbf-95e6-6beb151b45e7" (UID: "835f68ba-dac2-4cbf-95e6-6beb151b45e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:59:24.926630 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:24.926616 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "835f68ba-dac2-4cbf-95e6-6beb151b45e7" (UID: "835f68ba-dac2-4cbf-95e6-6beb151b45e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 14:59:25.025780 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.025747 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-credential-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:59:25.025780 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.025779 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-envoy\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:59:25.025981 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.025791 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-data\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:59:25.025981 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.025802 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-token\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:59:25.025981 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.025813 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istio-podinfo\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:59:25.025981 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.025824 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/835f68ba-dac2-4cbf-95e6-6beb151b45e7-istiod-ca-cert\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:59:25.025981 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.025836 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvkrh\" (UniqueName: \"kubernetes.io/projected/835f68ba-dac2-4cbf-95e6-6beb151b45e7-kube-api-access-jvkrh\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:59:25.525932 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.525899 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" event={"ID":"efca6046-49f3-4890-ba1e-f448e24c8d04","Type":"ContainerStarted","Data":"e1a7e9b1fb4ac580ce904626dde2c7badd7b9025257909162d7886fce0f395bc"} Jul 24 14:59:25.526352 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.525951 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" event={"ID":"efca6046-49f3-4890-ba1e-f448e24c8d04","Type":"ContainerStarted","Data":"f2a61d14e21e755d44ccf11e6f5be8289e74a1f213db633f7263812a396d7a18"} Jul 24 14:59:25.526352 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.526019 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" Jul 24 14:59:25.527767 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.527739 2581 generic.go:356] "Generic (PLEG): container finished" podID="835f68ba-dac2-4cbf-95e6-6beb151b45e7" containerID="66b60d9c8fcc64ed6b53e3ae5e9265d4c334bdf5ac5e0905b4fa80482c93b854" exitCode=0 Jul 24 14:59:25.527881 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.527778 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" event={"ID":"835f68ba-dac2-4cbf-95e6-6beb151b45e7","Type":"ContainerDied","Data":"66b60d9c8fcc64ed6b53e3ae5e9265d4c334bdf5ac5e0905b4fa80482c93b854"} Jul 24 14:59:25.527881 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.527802 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" Jul 24 14:59:25.527881 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.527820 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5" event={"ID":"835f68ba-dac2-4cbf-95e6-6beb151b45e7","Type":"ContainerDied","Data":"8aa98c1138f446d87e0453712930e4fe9a30ea59e3e74d8757b1c398482892e7"} Jul 24 14:59:25.527881 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.527851 2581 scope.go:117] "RemoveContainer" containerID="66b60d9c8fcc64ed6b53e3ae5e9265d4c334bdf5ac5e0905b4fa80482c93b854" Jul 24 14:59:25.536790 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.536775 2581 scope.go:117] "RemoveContainer" containerID="a767cdd97799fe1dee0e59ba8dac8af6ae6350db8239e29cdd650d0bc07da333" Jul 24 14:59:25.545031 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.544974 2581 scope.go:117] "RemoveContainer" containerID="66b60d9c8fcc64ed6b53e3ae5e9265d4c334bdf5ac5e0905b4fa80482c93b854" Jul 24 14:59:25.545800 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:59:25.545774 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66b60d9c8fcc64ed6b53e3ae5e9265d4c334bdf5ac5e0905b4fa80482c93b854\": container with ID starting with 66b60d9c8fcc64ed6b53e3ae5e9265d4c334bdf5ac5e0905b4fa80482c93b854 not found: ID does not exist" containerID="66b60d9c8fcc64ed6b53e3ae5e9265d4c334bdf5ac5e0905b4fa80482c93b854" Jul 24 14:59:25.545894 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.545806 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66b60d9c8fcc64ed6b53e3ae5e9265d4c334bdf5ac5e0905b4fa80482c93b854"} err="failed to get container status \"66b60d9c8fcc64ed6b53e3ae5e9265d4c334bdf5ac5e0905b4fa80482c93b854\": rpc error: code = NotFound desc = could not find container \"66b60d9c8fcc64ed6b53e3ae5e9265d4c334bdf5ac5e0905b4fa80482c93b854\": container with ID starting with 66b60d9c8fcc64ed6b53e3ae5e9265d4c334bdf5ac5e0905b4fa80482c93b854 not found: ID does not exist" Jul 24 14:59:25.545894 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.545823 2581 scope.go:117] "RemoveContainer" containerID="a767cdd97799fe1dee0e59ba8dac8af6ae6350db8239e29cdd650d0bc07da333" Jul 24 14:59:25.546120 ip-10-0-142-64 kubenswrapper[2581]: E0724 14:59:25.546099 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a767cdd97799fe1dee0e59ba8dac8af6ae6350db8239e29cdd650d0bc07da333\": container with ID starting with a767cdd97799fe1dee0e59ba8dac8af6ae6350db8239e29cdd650d0bc07da333 not found: ID does not exist" containerID="a767cdd97799fe1dee0e59ba8dac8af6ae6350db8239e29cdd650d0bc07da333" Jul 24 14:59:25.546171 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.546124 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a767cdd97799fe1dee0e59ba8dac8af6ae6350db8239e29cdd650d0bc07da333"} err="failed to get container status \"a767cdd97799fe1dee0e59ba8dac8af6ae6350db8239e29cdd650d0bc07da333\": rpc error: code = NotFound desc = could not find container \"a767cdd97799fe1dee0e59ba8dac8af6ae6350db8239e29cdd650d0bc07da333\": container with ID starting with a767cdd97799fe1dee0e59ba8dac8af6ae6350db8239e29cdd650d0bc07da333 not found: ID does not exist" Jul 24 14:59:25.548170 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.548121 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" podStartSLOduration=1.548105428 podStartE2EDuration="1.548105428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:59:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:59:25.545560383 +0000 UTC m=+1661.102476274" watchObservedRunningTime="2026-07-24 14:59:25.548105428 +0000 UTC m=+1661.105021343" Jul 24 14:59:25.560295 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.560271 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5"] Jul 24 14:59:25.563859 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:25.563838 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-639b4a8c-openshift-default-79d8f674bd-wmvw5"] Jul 24 14:59:26.973351 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:26.973316 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="835f68ba-dac2-4cbf-95e6-6beb151b45e7" path="/var/lib/kubelet/pods/835f68ba-dac2-4cbf-95e6-6beb151b45e7/volumes" Jul 24 14:59:36.535927 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:36.535886 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" Jul 24 14:59:37.512643 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:37.512602 2581 patch_prober.go:28] interesting pod/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 24 14:59:37.512856 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:37.512662 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" podUID="1051066d-75d4-4979-99e8-038c10268fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 24 14:59:37.603113 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:37.603082 2581 generic.go:356] "Generic (PLEG): container finished" podID="1051066d-75d4-4979-99e8-038c10268fe7" containerID="a1d48dae2a2699a5baa99bb64ca84b9cb7b8b48d5ce328c4fbf6a8d2378b2852" exitCode=0 Jul 24 14:59:37.603499 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:37.603158 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" event={"ID":"1051066d-75d4-4979-99e8-038c10268fe7","Type":"ContainerDied","Data":"a1d48dae2a2699a5baa99bb64ca84b9cb7b8b48d5ce328c4fbf6a8d2378b2852"} Jul 24 14:59:37.603612 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:37.603597 2581 scope.go:117] "RemoveContainer" containerID="a1d48dae2a2699a5baa99bb64ca84b9cb7b8b48d5ce328c4fbf6a8d2378b2852" Jul 24 14:59:37.604587 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:37.604559 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:59:37.604689 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:37.604642 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:59:37.604757 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:37.604689 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 14:59:38.610449 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:38.610414 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" event={"ID":"1051066d-75d4-4979-99e8-038c10268fe7","Type":"ContainerStarted","Data":"de30984e9d24eae180e14f9b7bf5703d828689127cc9830414f02d6c46e369ca"} Jul 24 14:59:38.773900 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:38.773856 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:38.774129 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:38.774107 2581 patch_prober.go:28] interesting pod/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 24 14:59:38.774175 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:38.774154 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" podUID="1051066d-75d4-4979-99e8-038c10268fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 24 14:59:39.774078 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:39.774048 2581 patch_prober.go:28] interesting pod/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 24 14:59:39.774488 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:39.774097 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" podUID="1051066d-75d4-4979-99e8-038c10268fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 24 14:59:40.773872 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:40.773823 2581 patch_prober.go:28] interesting pod/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 24 14:59:40.774083 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:40.773897 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" podUID="1051066d-75d4-4979-99e8-038c10268fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 24 14:59:41.774087 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:41.774046 2581 patch_prober.go:28] interesting pod/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 24 14:59:41.774509 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:41.774115 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" podUID="1051066d-75d4-4979-99e8-038c10268fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 24 14:59:42.778420 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:42.778390 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:42.778890 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:42.778839 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:42.779598 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:42.779577 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 14:59:58.576418 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:58.576383 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4"] Jul 24 14:59:58.577019 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:58.576819 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" podUID="efca6046-49f3-4890-ba1e-f448e24c8d04" containerName="payload-processing" containerID="cri-o://e1a7e9b1fb4ac580ce904626dde2c7badd7b9025257909162d7886fce0f395bc" gracePeriod=30 Jul 24 14:59:58.717184 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:58.717148 2581 generic.go:356] "Generic (PLEG): container finished" podID="efca6046-49f3-4890-ba1e-f448e24c8d04" containerID="e1a7e9b1fb4ac580ce904626dde2c7badd7b9025257909162d7886fce0f395bc" exitCode=0 Jul 24 14:59:58.717379 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:58.717179 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" event={"ID":"efca6046-49f3-4890-ba1e-f448e24c8d04","Type":"ContainerDied","Data":"e1a7e9b1fb4ac580ce904626dde2c7badd7b9025257909162d7886fce0f395bc"} Jul 24 14:59:58.850275 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:58.850249 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" Jul 24 14:59:58.942817 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:58.942782 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efca6046-49f3-4890-ba1e-f448e24c8d04-plugins-config-volume\") pod \"efca6046-49f3-4890-ba1e-f448e24c8d04\" (UID: \"efca6046-49f3-4890-ba1e-f448e24c8d04\") " Jul 24 14:59:58.942817 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:58.942819 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l7lm\" (UniqueName: \"kubernetes.io/projected/efca6046-49f3-4890-ba1e-f448e24c8d04-kube-api-access-6l7lm\") pod \"efca6046-49f3-4890-ba1e-f448e24c8d04\" (UID: \"efca6046-49f3-4890-ba1e-f448e24c8d04\") " Jul 24 14:59:58.943294 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:58.943262 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efca6046-49f3-4890-ba1e-f448e24c8d04-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "efca6046-49f3-4890-ba1e-f448e24c8d04" (UID: "efca6046-49f3-4890-ba1e-f448e24c8d04"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:59:58.945094 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:58.945066 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efca6046-49f3-4890-ba1e-f448e24c8d04-kube-api-access-6l7lm" (OuterVolumeSpecName: "kube-api-access-6l7lm") pod "efca6046-49f3-4890-ba1e-f448e24c8d04" (UID: "efca6046-49f3-4890-ba1e-f448e24c8d04"). InnerVolumeSpecName "kube-api-access-6l7lm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:59:59.044522 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:59.044491 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efca6046-49f3-4890-ba1e-f448e24c8d04-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:59:59.044522 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:59.044517 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l7lm\" (UniqueName: \"kubernetes.io/projected/efca6046-49f3-4890-ba1e-f448e24c8d04-kube-api-access-6l7lm\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 14:59:59.723833 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:59.723800 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" Jul 24 14:59:59.723833 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:59.723825 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4" event={"ID":"efca6046-49f3-4890-ba1e-f448e24c8d04","Type":"ContainerDied","Data":"f2a61d14e21e755d44ccf11e6f5be8289e74a1f213db633f7263812a396d7a18"} Jul 24 14:59:59.724423 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:59.723883 2581 scope.go:117] "RemoveContainer" containerID="e1a7e9b1fb4ac580ce904626dde2c7badd7b9025257909162d7886fce0f395bc" Jul 24 14:59:59.748559 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:59.744469 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4"] Jul 24 14:59:59.753020 ip-10-0-142-64 kubenswrapper[2581]: I0724 14:59:59.752995 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-5084c046-6dfd4cd9c-8k2n4"] Jul 24 15:00:00.972953 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:00.972915 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efca6046-49f3-4890-ba1e-f448e24c8d04" path="/var/lib/kubelet/pods/efca6046-49f3-4890-ba1e-f448e24c8d04/volumes" Jul 24 15:00:03.226947 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:03.226916 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh"] Jul 24 15:00:03.227389 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:03.227148 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" podUID="1051066d-75d4-4979-99e8-038c10268fe7" containerName="istio-proxy" containerID="cri-o://de30984e9d24eae180e14f9b7bf5703d828689127cc9830414f02d6c46e369ca" gracePeriod=30 Jul 24 15:00:04.064984 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.064952 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl"] Jul 24 15:00:04.065349 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.065336 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="835f68ba-dac2-4cbf-95e6-6beb151b45e7" containerName="istio-proxy" Jul 24 15:00:04.065415 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.065349 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="835f68ba-dac2-4cbf-95e6-6beb151b45e7" containerName="istio-proxy" Jul 24 15:00:04.065415 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.065359 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efca6046-49f3-4890-ba1e-f448e24c8d04" containerName="payload-processing" Jul 24 15:00:04.065415 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.065365 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="efca6046-49f3-4890-ba1e-f448e24c8d04" containerName="payload-processing" Jul 24 15:00:04.065597 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.065443 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="efca6046-49f3-4890-ba1e-f448e24c8d04" containerName="payload-processing" Jul 24 15:00:04.065597 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.065452 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="835f68ba-dac2-4cbf-95e6-6beb151b45e7" containerName="istio-proxy" Jul 24 15:00:04.065597 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.065460 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="835f68ba-dac2-4cbf-95e6-6beb151b45e7" containerName="istio-proxy" Jul 24 15:00:04.069900 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.069878 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.073391 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.073368 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4c7371ad-openshift-default-dockercfg-rbnwk\"" Jul 24 15:00:04.086429 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.086403 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl"] Jul 24 15:00:04.194674 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.194639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-credential-socket\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.194674 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.194678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-token\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.194911 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.194703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-data\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.194911 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.194769 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jjvt\" (UniqueName: \"kubernetes.io/projected/2be27b98-86e8-42be-87ce-b9747b9664bd-kube-api-access-2jjvt\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.194911 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.194829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-envoy\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.194911 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.194881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2be27b98-86e8-42be-87ce-b9747b9664bd-istiod-ca-cert\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.195076 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.194927 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-workload-socket\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.195076 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.194958 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-workload-certs\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.195076 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.194973 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-podinfo\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.295921 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.295888 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jjvt\" (UniqueName: \"kubernetes.io/projected/2be27b98-86e8-42be-87ce-b9747b9664bd-kube-api-access-2jjvt\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.296402 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.295947 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-envoy\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.296402 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.295982 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2be27b98-86e8-42be-87ce-b9747b9664bd-istiod-ca-cert\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.296402 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.296029 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-workload-socket\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.296402 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.296065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-workload-certs\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.296402 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.296089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-podinfo\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.296402 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.296169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-credential-socket\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.296402 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.296192 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-token\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.296402 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.296225 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-data\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.296807 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.296464 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-workload-socket\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.296807 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.296577 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-workload-certs\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.296807 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.296657 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-credential-socket\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.296807 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.296759 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-data\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.296949 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.296862 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2be27b98-86e8-42be-87ce-b9747b9664bd-istiod-ca-cert\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.298381 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.298363 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-envoy\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.298638 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.298621 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-podinfo\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.310439 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.310412 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-token\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.311642 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.311620 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jjvt\" (UniqueName: \"kubernetes.io/projected/2be27b98-86e8-42be-87ce-b9747b9664bd-kube-api-access-2jjvt\") pod \"e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.380474 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.380381 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:04.523179 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.523138 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl"] Jul 24 15:00:04.528378 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.528331 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:00:04.528486 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.528465 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:00:04.528620 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.528571 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:00:04.751793 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.751697 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" event={"ID":"2be27b98-86e8-42be-87ce-b9747b9664bd","Type":"ContainerStarted","Data":"b899af8e31ba00216be78ab84ff9d842a2f01bb8a8f1a9433005dcee712050ee"} Jul 24 15:00:04.751793 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.751761 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" event={"ID":"2be27b98-86e8-42be-87ce-b9747b9664bd","Type":"ContainerStarted","Data":"e29eb090048f5c859253c9d76c4b81e497ea1fa86b8ea619b0aba0b1650b10f7"} Jul 24 15:00:04.773455 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:04.773396 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" podStartSLOduration=0.77337543 podStartE2EDuration="773.37543ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:00:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:00:04.773264653 +0000 UTC m=+1700.330180549" watchObservedRunningTime="2026-07-24 15:00:04.77337543 +0000 UTC m=+1700.330291322" Jul 24 15:00:05.381360 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:05.381323 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:05.386263 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:05.386237 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:05.758406 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:05.758315 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:05.759253 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:05.759231 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:07.029479 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.029442 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5"] Jul 24 15:00:07.029901 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.029855 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="835f68ba-dac2-4cbf-95e6-6beb151b45e7" containerName="istio-proxy" Jul 24 15:00:07.029901 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.029867 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="835f68ba-dac2-4cbf-95e6-6beb151b45e7" containerName="istio-proxy" Jul 24 15:00:07.033182 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.033160 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" Jul 24 15:00:07.035573 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.035553 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-4c7371ad-dockercfg-q4w2d\"" Jul 24 15:00:07.035692 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.035633 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4c7371ad\"" Jul 24 15:00:07.049494 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.049470 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5"] Jul 24 15:00:07.052457 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.052432 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn"] Jul 24 15:00:07.056417 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.056392 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" Jul 24 15:00:07.067236 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.067211 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn"] Jul 24 15:00:07.124548 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.124494 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25q82\" (UniqueName: \"kubernetes.io/projected/98de7b31-530f-4266-b5a6-7402f6fafcf0-kube-api-access-25q82\") pod \"payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn\" (UID: \"98de7b31-530f-4266-b5a6-7402f6fafcf0\") " pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" Jul 24 15:00:07.124748 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.124670 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0aae1a3-a6df-48eb-a769-dd98a587087f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5\" (UID: \"b0aae1a3-a6df-48eb-a769-dd98a587087f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" Jul 24 15:00:07.124748 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.124726 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98de7b31-530f-4266-b5a6-7402f6fafcf0-plugins-config-volume\") pod \"payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn\" (UID: \"98de7b31-530f-4266-b5a6-7402f6fafcf0\") " pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" Jul 24 15:00:07.124870 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.124758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k75h6\" (UniqueName: \"kubernetes.io/projected/b0aae1a3-a6df-48eb-a769-dd98a587087f-kube-api-access-k75h6\") pod \"payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5\" (UID: \"b0aae1a3-a6df-48eb-a769-dd98a587087f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" Jul 24 15:00:07.226013 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.225917 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0aae1a3-a6df-48eb-a769-dd98a587087f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5\" (UID: \"b0aae1a3-a6df-48eb-a769-dd98a587087f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" Jul 24 15:00:07.226013 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.225981 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98de7b31-530f-4266-b5a6-7402f6fafcf0-plugins-config-volume\") pod \"payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn\" (UID: \"98de7b31-530f-4266-b5a6-7402f6fafcf0\") " pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" Jul 24 15:00:07.226013 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.226010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k75h6\" (UniqueName: \"kubernetes.io/projected/b0aae1a3-a6df-48eb-a769-dd98a587087f-kube-api-access-k75h6\") pod \"payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5\" (UID: \"b0aae1a3-a6df-48eb-a769-dd98a587087f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" Jul 24 15:00:07.226258 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.226048 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25q82\" (UniqueName: \"kubernetes.io/projected/98de7b31-530f-4266-b5a6-7402f6fafcf0-kube-api-access-25q82\") pod \"payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn\" (UID: \"98de7b31-530f-4266-b5a6-7402f6fafcf0\") " pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" Jul 24 15:00:07.226691 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.226671 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0aae1a3-a6df-48eb-a769-dd98a587087f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5\" (UID: \"b0aae1a3-a6df-48eb-a769-dd98a587087f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" Jul 24 15:00:07.226767 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.226737 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98de7b31-530f-4266-b5a6-7402f6fafcf0-plugins-config-volume\") pod \"payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn\" (UID: \"98de7b31-530f-4266-b5a6-7402f6fafcf0\") " pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" Jul 24 15:00:07.234946 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.234925 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25q82\" (UniqueName: \"kubernetes.io/projected/98de7b31-530f-4266-b5a6-7402f6fafcf0-kube-api-access-25q82\") pod \"payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn\" (UID: \"98de7b31-530f-4266-b5a6-7402f6fafcf0\") " pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" Jul 24 15:00:07.235050 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.235021 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k75h6\" (UniqueName: \"kubernetes.io/projected/b0aae1a3-a6df-48eb-a769-dd98a587087f-kube-api-access-k75h6\") pod \"payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5\" (UID: \"b0aae1a3-a6df-48eb-a769-dd98a587087f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" Jul 24 15:00:07.344351 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.344264 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" Jul 24 15:00:07.366708 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.366672 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" Jul 24 15:00:07.513763 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.513698 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5"] Jul 24 15:00:07.515979 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:00:07.515952 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0aae1a3_a6df_48eb_a769_dd98a587087f.slice/crio-e53f01a0b5492910383c81f81f1f75b2859012d71f834bdbfb5b489ea8eb0c63 WatchSource:0}: Error finding container e53f01a0b5492910383c81f81f1f75b2859012d71f834bdbfb5b489ea8eb0c63: Status 404 returned error can't find the container with id e53f01a0b5492910383c81f81f1f75b2859012d71f834bdbfb5b489ea8eb0c63 Jul 24 15:00:07.536800 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.536773 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn"] Jul 24 15:00:07.538359 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:00:07.538333 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98de7b31_530f_4266_b5a6_7402f6fafcf0.slice/crio-3b3b14c10ca63bee8d1fc82a7f4c11046fd227f5f70369e4f1c8111f5dbf3b5e WatchSource:0}: Error finding container 3b3b14c10ca63bee8d1fc82a7f4c11046fd227f5f70369e4f1c8111f5dbf3b5e: Status 404 returned error can't find the container with id 3b3b14c10ca63bee8d1fc82a7f4c11046fd227f5f70369e4f1c8111f5dbf3b5e Jul 24 15:00:07.772215 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.772115 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" event={"ID":"98de7b31-530f-4266-b5a6-7402f6fafcf0","Type":"ContainerStarted","Data":"e8205f5a0a38c4c632a8fd5a1ad5ccc57b3cd6464ee16a45ca66e7e9ee188f9e"} Jul 24 15:00:07.772215 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.772177 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" event={"ID":"98de7b31-530f-4266-b5a6-7402f6fafcf0","Type":"ContainerStarted","Data":"3b3b14c10ca63bee8d1fc82a7f4c11046fd227f5f70369e4f1c8111f5dbf3b5e"} Jul 24 15:00:07.772449 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.772311 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" Jul 24 15:00:07.774157 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.774131 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" event={"ID":"b0aae1a3-a6df-48eb-a769-dd98a587087f","Type":"ContainerStarted","Data":"bab98c1972479f7b430dd0a27a30ce3a1b7b44a34d293f330311eec6c1f82f03"} Jul 24 15:00:07.774301 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.774176 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" event={"ID":"b0aae1a3-a6df-48eb-a769-dd98a587087f","Type":"ContainerStarted","Data":"e53f01a0b5492910383c81f81f1f75b2859012d71f834bdbfb5b489ea8eb0c63"} Jul 24 15:00:07.774301 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.774231 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" Jul 24 15:00:07.793178 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.793126 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" podStartSLOduration=0.793110343 podStartE2EDuration="793.110343ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:00:07.790830019 +0000 UTC m=+1703.347745912" watchObservedRunningTime="2026-07-24 15:00:07.793110343 +0000 UTC m=+1703.350026234" Jul 24 15:00:07.813129 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:07.813072 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" podStartSLOduration=0.813055058 podStartE2EDuration="813.055058ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:00:07.811293214 +0000 UTC m=+1703.368209107" watchObservedRunningTime="2026-07-24 15:00:07.813055058 +0000 UTC m=+1703.369970949" Jul 24 15:00:08.498061 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.498004 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 15:00:08.640584 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.640521 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqv2n\" (UniqueName: \"kubernetes.io/projected/1051066d-75d4-4979-99e8-038c10268fe7-kube-api-access-lqv2n\") pod \"1051066d-75d4-4979-99e8-038c10268fe7\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " Jul 24 15:00:08.640780 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.640618 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-workload-socket\") pod \"1051066d-75d4-4979-99e8-038c10268fe7\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " Jul 24 15:00:08.640780 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.640732 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-workload-certs\") pod \"1051066d-75d4-4979-99e8-038c10268fe7\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " Jul 24 15:00:08.640901 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.640788 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1051066d-75d4-4979-99e8-038c10268fe7-istiod-ca-cert\") pod \"1051066d-75d4-4979-99e8-038c10268fe7\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " Jul 24 15:00:08.640901 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.640852 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1051066d-75d4-4979-99e8-038c10268fe7-istio-token\") pod \"1051066d-75d4-4979-99e8-038c10268fe7\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " Jul 24 15:00:08.641008 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.640850 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1051066d-75d4-4979-99e8-038c10268fe7" (UID: "1051066d-75d4-4979-99e8-038c10268fe7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:00:08.641008 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.640901 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-credential-socket\") pod \"1051066d-75d4-4979-99e8-038c10268fe7\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " Jul 24 15:00:08.641130 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.640993 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1051066d-75d4-4979-99e8-038c10268fe7" (UID: "1051066d-75d4-4979-99e8-038c10268fe7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:00:08.641130 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.641016 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-istio-envoy\") pod \"1051066d-75d4-4979-99e8-038c10268fe7\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " Jul 24 15:00:08.641130 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.641105 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1051066d-75d4-4979-99e8-038c10268fe7-istio-podinfo\") pod \"1051066d-75d4-4979-99e8-038c10268fe7\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " Jul 24 15:00:08.641130 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.641120 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1051066d-75d4-4979-99e8-038c10268fe7" (UID: "1051066d-75d4-4979-99e8-038c10268fe7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:00:08.641337 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.641163 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-istio-data\") pod \"1051066d-75d4-4979-99e8-038c10268fe7\" (UID: \"1051066d-75d4-4979-99e8-038c10268fe7\") " Jul 24 15:00:08.641337 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.641174 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1051066d-75d4-4979-99e8-038c10268fe7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1051066d-75d4-4979-99e8-038c10268fe7" (UID: "1051066d-75d4-4979-99e8-038c10268fe7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:00:08.641546 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.641503 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1051066d-75d4-4979-99e8-038c10268fe7-istiod-ca-cert\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:08.641692 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.641559 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-credential-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:08.641692 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.641575 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-workload-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:08.641692 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.641587 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-workload-certs\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:08.642024 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.641999 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-istio-data" (OuterVolumeSpecName: "istio-data") pod "1051066d-75d4-4979-99e8-038c10268fe7" (UID: "1051066d-75d4-4979-99e8-038c10268fe7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:00:08.643347 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.643326 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1051066d-75d4-4979-99e8-038c10268fe7-kube-api-access-lqv2n" (OuterVolumeSpecName: "kube-api-access-lqv2n") pod "1051066d-75d4-4979-99e8-038c10268fe7" (UID: "1051066d-75d4-4979-99e8-038c10268fe7"). InnerVolumeSpecName "kube-api-access-lqv2n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:00:08.643479 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.643457 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1051066d-75d4-4979-99e8-038c10268fe7-istio-token" (OuterVolumeSpecName: "istio-token") pod "1051066d-75d4-4979-99e8-038c10268fe7" (UID: "1051066d-75d4-4979-99e8-038c10268fe7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:00:08.643479 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.643458 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1051066d-75d4-4979-99e8-038c10268fe7" (UID: "1051066d-75d4-4979-99e8-038c10268fe7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:00:08.643659 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.643481 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1051066d-75d4-4979-99e8-038c10268fe7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1051066d-75d4-4979-99e8-038c10268fe7" (UID: "1051066d-75d4-4979-99e8-038c10268fe7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 15:00:08.742208 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.742169 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqv2n\" (UniqueName: \"kubernetes.io/projected/1051066d-75d4-4979-99e8-038c10268fe7-kube-api-access-lqv2n\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:08.742208 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.742203 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1051066d-75d4-4979-99e8-038c10268fe7-istio-token\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:08.742208 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.742213 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-istio-envoy\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:08.742208 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.742221 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1051066d-75d4-4979-99e8-038c10268fe7-istio-podinfo\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:08.742477 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.742229 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1051066d-75d4-4979-99e8-038c10268fe7-istio-data\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:08.781601 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.781566 2581 generic.go:356] "Generic (PLEG): container finished" podID="1051066d-75d4-4979-99e8-038c10268fe7" containerID="de30984e9d24eae180e14f9b7bf5703d828689127cc9830414f02d6c46e369ca" exitCode=0 Jul 24 15:00:08.781769 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.781606 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" Jul 24 15:00:08.781769 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.781652 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" event={"ID":"1051066d-75d4-4979-99e8-038c10268fe7","Type":"ContainerDied","Data":"de30984e9d24eae180e14f9b7bf5703d828689127cc9830414f02d6c46e369ca"} Jul 24 15:00:08.781769 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.781731 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh" event={"ID":"1051066d-75d4-4979-99e8-038c10268fe7","Type":"ContainerDied","Data":"973c7a72b5465d6b44dff0eb85740aea35336dac70919fe78f4070ccd0d50b25"} Jul 24 15:00:08.781769 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.781760 2581 scope.go:117] "RemoveContainer" containerID="de30984e9d24eae180e14f9b7bf5703d828689127cc9830414f02d6c46e369ca" Jul 24 15:00:08.791597 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.791576 2581 scope.go:117] "RemoveContainer" containerID="a1d48dae2a2699a5baa99bb64ca84b9cb7b8b48d5ce328c4fbf6a8d2378b2852" Jul 24 15:00:08.800077 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.800060 2581 scope.go:117] "RemoveContainer" containerID="de30984e9d24eae180e14f9b7bf5703d828689127cc9830414f02d6c46e369ca" Jul 24 15:00:08.800352 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:00:08.800330 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de30984e9d24eae180e14f9b7bf5703d828689127cc9830414f02d6c46e369ca\": container with ID starting with de30984e9d24eae180e14f9b7bf5703d828689127cc9830414f02d6c46e369ca not found: ID does not exist" containerID="de30984e9d24eae180e14f9b7bf5703d828689127cc9830414f02d6c46e369ca" Jul 24 15:00:08.800453 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.800364 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de30984e9d24eae180e14f9b7bf5703d828689127cc9830414f02d6c46e369ca"} err="failed to get container status \"de30984e9d24eae180e14f9b7bf5703d828689127cc9830414f02d6c46e369ca\": rpc error: code = NotFound desc = could not find container \"de30984e9d24eae180e14f9b7bf5703d828689127cc9830414f02d6c46e369ca\": container with ID starting with de30984e9d24eae180e14f9b7bf5703d828689127cc9830414f02d6c46e369ca not found: ID does not exist" Jul 24 15:00:08.800453 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.800383 2581 scope.go:117] "RemoveContainer" containerID="a1d48dae2a2699a5baa99bb64ca84b9cb7b8b48d5ce328c4fbf6a8d2378b2852" Jul 24 15:00:08.800657 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:00:08.800640 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1d48dae2a2699a5baa99bb64ca84b9cb7b8b48d5ce328c4fbf6a8d2378b2852\": container with ID starting with a1d48dae2a2699a5baa99bb64ca84b9cb7b8b48d5ce328c4fbf6a8d2378b2852 not found: ID does not exist" containerID="a1d48dae2a2699a5baa99bb64ca84b9cb7b8b48d5ce328c4fbf6a8d2378b2852" Jul 24 15:00:08.800704 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.800662 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1d48dae2a2699a5baa99bb64ca84b9cb7b8b48d5ce328c4fbf6a8d2378b2852"} err="failed to get container status \"a1d48dae2a2699a5baa99bb64ca84b9cb7b8b48d5ce328c4fbf6a8d2378b2852\": rpc error: code = NotFound desc = could not find container \"a1d48dae2a2699a5baa99bb64ca84b9cb7b8b48d5ce328c4fbf6a8d2378b2852\": container with ID starting with a1d48dae2a2699a5baa99bb64ca84b9cb7b8b48d5ce328c4fbf6a8d2378b2852 not found: ID does not exist" Jul 24 15:00:08.806181 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.806159 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh"] Jul 24 15:00:08.810540 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.810508 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-5084c046-gw-openshift-default-cf84c86d8-tp8gh"] Jul 24 15:00:08.972259 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:08.972223 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1051066d-75d4-4979-99e8-038c10268fe7" path="/var/lib/kubelet/pods/1051066d-75d4-4979-99e8-038c10268fe7/volumes" Jul 24 15:00:18.784755 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:18.784720 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" Jul 24 15:00:18.785201 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:18.784929 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" Jul 24 15:00:21.091806 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:21.091774 2581 patch_prober.go:28] interesting pod/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:58574->10.132.0.54:15021: read: connection reset by peer" start-of-body= Jul 24 15:00:21.092140 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:21.091865 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" podUID="2be27b98-86e8-42be-87ce-b9747b9664bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:58574->10.132.0.54:15021: read: connection reset by peer" Jul 24 15:00:21.857825 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:21.857792 2581 generic.go:356] "Generic (PLEG): container finished" podID="2be27b98-86e8-42be-87ce-b9747b9664bd" containerID="b899af8e31ba00216be78ab84ff9d842a2f01bb8a8f1a9433005dcee712050ee" exitCode=0 Jul 24 15:00:21.858003 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:21.857864 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" event={"ID":"2be27b98-86e8-42be-87ce-b9747b9664bd","Type":"ContainerDied","Data":"b899af8e31ba00216be78ab84ff9d842a2f01bb8a8f1a9433005dcee712050ee"} Jul 24 15:00:21.858293 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:21.858277 2581 scope.go:117] "RemoveContainer" containerID="b899af8e31ba00216be78ab84ff9d842a2f01bb8a8f1a9433005dcee712050ee" Jul 24 15:00:21.859264 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:21.859240 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:00:21.859333 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:21.859306 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:00:21.859382 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:21.859338 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:00:22.864724 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:22.864689 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" event={"ID":"2be27b98-86e8-42be-87ce-b9747b9664bd","Type":"ContainerStarted","Data":"6d783b37e68ba53ba32eaccad6b794d15172d823ca5a925090e51952ac001099"} Jul 24 15:00:23.381118 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:23.381077 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:23.381346 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:23.381323 2581 patch_prober.go:28] interesting pod/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 24 15:00:23.381408 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:23.381374 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" podUID="2be27b98-86e8-42be-87ce-b9747b9664bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 24 15:00:24.381215 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:24.381167 2581 patch_prober.go:28] interesting pod/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 24 15:00:24.381761 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:24.381263 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" podUID="2be27b98-86e8-42be-87ce-b9747b9664bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 24 15:00:25.380692 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:25.380660 2581 patch_prober.go:28] interesting pod/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 24 15:00:25.380883 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:25.380714 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" podUID="2be27b98-86e8-42be-87ce-b9747b9664bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 24 15:00:26.381340 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:26.381298 2581 patch_prober.go:28] interesting pod/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 24 15:00:26.381846 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:26.381364 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" podUID="2be27b98-86e8-42be-87ce-b9747b9664bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 24 15:00:27.384675 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:27.384641 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:27.385150 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:27.385025 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:27.385640 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:27.385622 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:42.479394 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.479353 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn"] Jul 24 15:00:42.479940 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.479570 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" podUID="98de7b31-530f-4266-b5a6-7402f6fafcf0" containerName="payload-processing" containerID="cri-o://e8205f5a0a38c4c632a8fd5a1ad5ccc57b3cd6464ee16a45ca66e7e9ee188f9e" gracePeriod=30 Jul 24 15:00:42.487430 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.487345 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5"] Jul 24 15:00:42.487681 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.487623 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" podUID="b0aae1a3-a6df-48eb-a769-dd98a587087f" containerName="payload-pre-processing" containerID="cri-o://bab98c1972479f7b430dd0a27a30ce3a1b7b44a34d293f330311eec6c1f82f03" gracePeriod=30 Jul 24 15:00:42.780940 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.780912 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" Jul 24 15:00:42.797066 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.797045 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" Jul 24 15:00:42.870685 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.870653 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25q82\" (UniqueName: \"kubernetes.io/projected/98de7b31-530f-4266-b5a6-7402f6fafcf0-kube-api-access-25q82\") pod \"98de7b31-530f-4266-b5a6-7402f6fafcf0\" (UID: \"98de7b31-530f-4266-b5a6-7402f6fafcf0\") " Jul 24 15:00:42.870890 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.870732 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0aae1a3-a6df-48eb-a769-dd98a587087f-plugins-config-volume\") pod \"b0aae1a3-a6df-48eb-a769-dd98a587087f\" (UID: \"b0aae1a3-a6df-48eb-a769-dd98a587087f\") " Jul 24 15:00:42.870890 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.870757 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98de7b31-530f-4266-b5a6-7402f6fafcf0-plugins-config-volume\") pod \"98de7b31-530f-4266-b5a6-7402f6fafcf0\" (UID: \"98de7b31-530f-4266-b5a6-7402f6fafcf0\") " Jul 24 15:00:42.870890 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.870781 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k75h6\" (UniqueName: \"kubernetes.io/projected/b0aae1a3-a6df-48eb-a769-dd98a587087f-kube-api-access-k75h6\") pod \"b0aae1a3-a6df-48eb-a769-dd98a587087f\" (UID: \"b0aae1a3-a6df-48eb-a769-dd98a587087f\") " Jul 24 15:00:42.871206 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.871178 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0aae1a3-a6df-48eb-a769-dd98a587087f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b0aae1a3-a6df-48eb-a769-dd98a587087f" (UID: "b0aae1a3-a6df-48eb-a769-dd98a587087f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:00:42.871206 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.871188 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98de7b31-530f-4266-b5a6-7402f6fafcf0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "98de7b31-530f-4266-b5a6-7402f6fafcf0" (UID: "98de7b31-530f-4266-b5a6-7402f6fafcf0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:00:42.872982 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.872960 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0aae1a3-a6df-48eb-a769-dd98a587087f-kube-api-access-k75h6" (OuterVolumeSpecName: "kube-api-access-k75h6") pod "b0aae1a3-a6df-48eb-a769-dd98a587087f" (UID: "b0aae1a3-a6df-48eb-a769-dd98a587087f"). InnerVolumeSpecName "kube-api-access-k75h6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:00:42.873077 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.873007 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98de7b31-530f-4266-b5a6-7402f6fafcf0-kube-api-access-25q82" (OuterVolumeSpecName: "kube-api-access-25q82") pod "98de7b31-530f-4266-b5a6-7402f6fafcf0" (UID: "98de7b31-530f-4266-b5a6-7402f6fafcf0"). InnerVolumeSpecName "kube-api-access-25q82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:00:42.972506 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.972472 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25q82\" (UniqueName: \"kubernetes.io/projected/98de7b31-530f-4266-b5a6-7402f6fafcf0-kube-api-access-25q82\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:42.972506 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.972502 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0aae1a3-a6df-48eb-a769-dd98a587087f-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:42.972811 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.972517 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98de7b31-530f-4266-b5a6-7402f6fafcf0-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:42.972811 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.972545 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k75h6\" (UniqueName: \"kubernetes.io/projected/b0aae1a3-a6df-48eb-a769-dd98a587087f-kube-api-access-k75h6\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:42.980637 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.980597 2581 generic.go:356] "Generic (PLEG): container finished" podID="98de7b31-530f-4266-b5a6-7402f6fafcf0" containerID="e8205f5a0a38c4c632a8fd5a1ad5ccc57b3cd6464ee16a45ca66e7e9ee188f9e" exitCode=0 Jul 24 15:00:42.980809 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.980653 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" Jul 24 15:00:42.980809 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.980676 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" event={"ID":"98de7b31-530f-4266-b5a6-7402f6fafcf0","Type":"ContainerDied","Data":"e8205f5a0a38c4c632a8fd5a1ad5ccc57b3cd6464ee16a45ca66e7e9ee188f9e"} Jul 24 15:00:42.980809 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.980733 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn" event={"ID":"98de7b31-530f-4266-b5a6-7402f6fafcf0","Type":"ContainerDied","Data":"3b3b14c10ca63bee8d1fc82a7f4c11046fd227f5f70369e4f1c8111f5dbf3b5e"} Jul 24 15:00:42.980809 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.980763 2581 scope.go:117] "RemoveContainer" containerID="e8205f5a0a38c4c632a8fd5a1ad5ccc57b3cd6464ee16a45ca66e7e9ee188f9e" Jul 24 15:00:42.982097 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.982073 2581 generic.go:356] "Generic (PLEG): container finished" podID="b0aae1a3-a6df-48eb-a769-dd98a587087f" containerID="bab98c1972479f7b430dd0a27a30ce3a1b7b44a34d293f330311eec6c1f82f03" exitCode=0 Jul 24 15:00:42.982185 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.982105 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" event={"ID":"b0aae1a3-a6df-48eb-a769-dd98a587087f","Type":"ContainerDied","Data":"bab98c1972479f7b430dd0a27a30ce3a1b7b44a34d293f330311eec6c1f82f03"} Jul 24 15:00:42.982185 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.982138 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" Jul 24 15:00:42.982185 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.982165 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5" event={"ID":"b0aae1a3-a6df-48eb-a769-dd98a587087f","Type":"ContainerDied","Data":"e53f01a0b5492910383c81f81f1f75b2859012d71f834bdbfb5b489ea8eb0c63"} Jul 24 15:00:42.992032 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.992015 2581 scope.go:117] "RemoveContainer" containerID="e8205f5a0a38c4c632a8fd5a1ad5ccc57b3cd6464ee16a45ca66e7e9ee188f9e" Jul 24 15:00:42.992289 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:00:42.992269 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8205f5a0a38c4c632a8fd5a1ad5ccc57b3cd6464ee16a45ca66e7e9ee188f9e\": container with ID starting with e8205f5a0a38c4c632a8fd5a1ad5ccc57b3cd6464ee16a45ca66e7e9ee188f9e not found: ID does not exist" containerID="e8205f5a0a38c4c632a8fd5a1ad5ccc57b3cd6464ee16a45ca66e7e9ee188f9e" Jul 24 15:00:42.992336 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.992297 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8205f5a0a38c4c632a8fd5a1ad5ccc57b3cd6464ee16a45ca66e7e9ee188f9e"} err="failed to get container status \"e8205f5a0a38c4c632a8fd5a1ad5ccc57b3cd6464ee16a45ca66e7e9ee188f9e\": rpc error: code = NotFound desc = could not find container \"e8205f5a0a38c4c632a8fd5a1ad5ccc57b3cd6464ee16a45ca66e7e9ee188f9e\": container with ID starting with e8205f5a0a38c4c632a8fd5a1ad5ccc57b3cd6464ee16a45ca66e7e9ee188f9e not found: ID does not exist" Jul 24 15:00:42.992336 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:42.992315 2581 scope.go:117] "RemoveContainer" containerID="bab98c1972479f7b430dd0a27a30ce3a1b7b44a34d293f330311eec6c1f82f03" Jul 24 15:00:43.003313 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:43.003296 2581 scope.go:117] "RemoveContainer" containerID="bab98c1972479f7b430dd0a27a30ce3a1b7b44a34d293f330311eec6c1f82f03" Jul 24 15:00:43.003598 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:00:43.003575 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bab98c1972479f7b430dd0a27a30ce3a1b7b44a34d293f330311eec6c1f82f03\": container with ID starting with bab98c1972479f7b430dd0a27a30ce3a1b7b44a34d293f330311eec6c1f82f03 not found: ID does not exist" containerID="bab98c1972479f7b430dd0a27a30ce3a1b7b44a34d293f330311eec6c1f82f03" Jul 24 15:00:43.003702 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:43.003603 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab98c1972479f7b430dd0a27a30ce3a1b7b44a34d293f330311eec6c1f82f03"} err="failed to get container status \"bab98c1972479f7b430dd0a27a30ce3a1b7b44a34d293f330311eec6c1f82f03\": rpc error: code = NotFound desc = could not find container \"bab98c1972479f7b430dd0a27a30ce3a1b7b44a34d293f330311eec6c1f82f03\": container with ID starting with bab98c1972479f7b430dd0a27a30ce3a1b7b44a34d293f330311eec6c1f82f03 not found: ID does not exist" Jul 24 15:00:43.006957 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:43.006934 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5"] Jul 24 15:00:43.011189 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:43.011168 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4c7371ad-7688bb868d-72rt5"] Jul 24 15:00:43.023031 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:43.023008 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn"] Jul 24 15:00:43.027505 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:43.027480 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4c7371ad-7446568dfb-ctlxn"] Jul 24 15:00:44.974941 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:44.974899 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98de7b31-530f-4266-b5a6-7402f6fafcf0" path="/var/lib/kubelet/pods/98de7b31-530f-4266-b5a6-7402f6fafcf0/volumes" Jul 24 15:00:44.975311 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:44.975266 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0aae1a3-a6df-48eb-a769-dd98a587087f" path="/var/lib/kubelet/pods/b0aae1a3-a6df-48eb-a769-dd98a587087f/volumes" Jul 24 15:00:48.184639 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:48.184605 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl"] Jul 24 15:00:48.185044 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:48.184832 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" podUID="2be27b98-86e8-42be-87ce-b9747b9664bd" containerName="istio-proxy" containerID="cri-o://6d783b37e68ba53ba32eaccad6b794d15172d823ca5a925090e51952ac001099" gracePeriod=30 Jul 24 15:00:49.037036 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.037003 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx"] Jul 24 15:00:49.037402 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.037390 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0aae1a3-a6df-48eb-a769-dd98a587087f" containerName="payload-pre-processing" Jul 24 15:00:49.037458 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.037404 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0aae1a3-a6df-48eb-a769-dd98a587087f" containerName="payload-pre-processing" Jul 24 15:00:49.037458 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.037416 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1051066d-75d4-4979-99e8-038c10268fe7" containerName="istio-proxy" Jul 24 15:00:49.037458 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.037422 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1051066d-75d4-4979-99e8-038c10268fe7" containerName="istio-proxy" Jul 24 15:00:49.037458 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.037429 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1051066d-75d4-4979-99e8-038c10268fe7" containerName="istio-proxy" Jul 24 15:00:49.037458 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.037435 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1051066d-75d4-4979-99e8-038c10268fe7" containerName="istio-proxy" Jul 24 15:00:49.037458 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.037442 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98de7b31-530f-4266-b5a6-7402f6fafcf0" containerName="payload-processing" Jul 24 15:00:49.037458 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.037448 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="98de7b31-530f-4266-b5a6-7402f6fafcf0" containerName="payload-processing" Jul 24 15:00:49.037694 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.037525 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1051066d-75d4-4979-99e8-038c10268fe7" containerName="istio-proxy" Jul 24 15:00:49.037694 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.037547 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="98de7b31-530f-4266-b5a6-7402f6fafcf0" containerName="payload-processing" Jul 24 15:00:49.037694 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.037554 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0aae1a3-a6df-48eb-a769-dd98a587087f" containerName="payload-pre-processing" Jul 24 15:00:49.039662 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.039645 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.043024 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.043003 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-2feafa84-openshift-default-dockercfg-4xfdb\"" Jul 24 15:00:49.057663 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.057630 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx"] Jul 24 15:00:49.124803 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.124764 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-workload-certs\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.124803 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.124812 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-data\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.125076 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.124843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-workload-socket\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.125076 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.124895 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-token\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.125076 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.124978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-podinfo\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.125076 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.125006 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-credential-socket\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.125076 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.125048 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-envoy\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.125338 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.125109 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istiod-ca-cert\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.125338 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.125172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8cjr\" (UniqueName: \"kubernetes.io/projected/fc1fbbfc-91db-4979-bd86-e526b3e9765e-kube-api-access-z8cjr\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.226555 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.226488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-workload-certs\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.226555 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.226560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-data\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.227102 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.226589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-workload-socket\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.227102 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.226620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-token\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.227102 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.226704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-podinfo\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.227102 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.226732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-credential-socket\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.227102 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.226763 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-envoy\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.227102 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.226810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istiod-ca-cert\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.227102 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.226860 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8cjr\" (UniqueName: \"kubernetes.io/projected/fc1fbbfc-91db-4979-bd86-e526b3e9765e-kube-api-access-z8cjr\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.227102 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.226974 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-workload-certs\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.227102 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.227000 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-data\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.227476 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.227398 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-workload-socket\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.227555 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.227502 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-credential-socket\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.227626 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.227602 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istiod-ca-cert\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.229394 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.229366 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-envoy\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.229498 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.229475 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-podinfo\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.239760 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.239736 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-token\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.240019 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.240001 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8cjr\" (UniqueName: \"kubernetes.io/projected/fc1fbbfc-91db-4979-bd86-e526b3e9765e-kube-api-access-z8cjr\") pod \"e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.352349 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.352233 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:49.513789 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.513755 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx"] Jul 24 15:00:49.514216 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:00:49.514193 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1fbbfc_91db_4979_bd86_e526b3e9765e.slice/crio-50512add1c4b269878de678bba8cbf7144185f395bbeab70d73fdca9cd004bc4 WatchSource:0}: Error finding container 50512add1c4b269878de678bba8cbf7144185f395bbeab70d73fdca9cd004bc4: Status 404 returned error can't find the container with id 50512add1c4b269878de678bba8cbf7144185f395bbeab70d73fdca9cd004bc4 Jul 24 15:00:49.516791 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.516754 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:00:49.516880 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.516855 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:00:49.516921 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:49.516894 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:00:50.021068 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:50.021031 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" event={"ID":"fc1fbbfc-91db-4979-bd86-e526b3e9765e","Type":"ContainerStarted","Data":"d17467f36609ab8b75830ef89aa5b1da322e9773238121481e07bf4aa88e06d3"} Jul 24 15:00:50.021251 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:50.021094 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" event={"ID":"fc1fbbfc-91db-4979-bd86-e526b3e9765e","Type":"ContainerStarted","Data":"50512add1c4b269878de678bba8cbf7144185f395bbeab70d73fdca9cd004bc4"} Jul 24 15:00:50.050217 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:50.050153 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" podStartSLOduration=2.050129483 podStartE2EDuration="2.050129483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:00:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:00:50.046496982 +0000 UTC m=+1745.603412876" watchObservedRunningTime="2026-07-24 15:00:50.050129483 +0000 UTC m=+1745.607045377" Jul 24 15:00:50.353028 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:50.352991 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:50.358648 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:50.358617 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:51.025957 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:51.025927 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:51.026916 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:51.026894 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:00:52.495233 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:52.495200 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9"] Jul 24 15:00:52.495694 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:52.495679 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1051066d-75d4-4979-99e8-038c10268fe7" containerName="istio-proxy" Jul 24 15:00:52.497813 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:52.497796 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" Jul 24 15:00:52.500688 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:52.500667 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-2feafa84-dockercfg-7x75w\"" Jul 24 15:00:52.500844 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:52.500826 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-2feafa84\"" Jul 24 15:00:52.525120 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:52.525090 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9"] Jul 24 15:00:52.660050 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:52.660019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70104359-4ce0-4d04-9665-6e433661c2bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9\" (UID: \"70104359-4ce0-4d04-9665-6e433661c2bb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" Jul 24 15:00:52.660224 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:52.660137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw78d\" (UniqueName: \"kubernetes.io/projected/70104359-4ce0-4d04-9665-6e433661c2bb-kube-api-access-rw78d\") pod \"payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9\" (UID: \"70104359-4ce0-4d04-9665-6e433661c2bb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" Jul 24 15:00:52.760860 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:52.760774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70104359-4ce0-4d04-9665-6e433661c2bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9\" (UID: \"70104359-4ce0-4d04-9665-6e433661c2bb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" Jul 24 15:00:52.761010 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:52.760883 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw78d\" (UniqueName: \"kubernetes.io/projected/70104359-4ce0-4d04-9665-6e433661c2bb-kube-api-access-rw78d\") pod \"payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9\" (UID: \"70104359-4ce0-4d04-9665-6e433661c2bb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" Jul 24 15:00:52.761470 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:52.761452 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70104359-4ce0-4d04-9665-6e433661c2bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9\" (UID: \"70104359-4ce0-4d04-9665-6e433661c2bb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" Jul 24 15:00:52.773345 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:52.773311 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw78d\" (UniqueName: \"kubernetes.io/projected/70104359-4ce0-4d04-9665-6e433661c2bb-kube-api-access-rw78d\") pod \"payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9\" (UID: \"70104359-4ce0-4d04-9665-6e433661c2bb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" Jul 24 15:00:52.808847 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:52.808815 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" Jul 24 15:00:52.963309 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:52.963282 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9"] Jul 24 15:00:52.965823 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:00:52.965791 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70104359_4ce0_4d04_9665_6e433661c2bb.slice/crio-8956599e763fafb5cf00f3607ac83de7ca320a910f8be45aa6918ba8e361ba61 WatchSource:0}: Error finding container 8956599e763fafb5cf00f3607ac83de7ca320a910f8be45aa6918ba8e361ba61: Status 404 returned error can't find the container with id 8956599e763fafb5cf00f3607ac83de7ca320a910f8be45aa6918ba8e361ba61 Jul 24 15:00:53.037589 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.037551 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" event={"ID":"70104359-4ce0-4d04-9665-6e433661c2bb","Type":"ContainerStarted","Data":"0602d95040647313923a6c02080c3032960ad54b7935841caa24922547dc8c96"} Jul 24 15:00:53.037721 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.037616 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" event={"ID":"70104359-4ce0-4d04-9665-6e433661c2bb","Type":"ContainerStarted","Data":"8956599e763fafb5cf00f3607ac83de7ca320a910f8be45aa6918ba8e361ba61"} Jul 24 15:00:53.037789 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.037770 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" Jul 24 15:00:53.092876 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.092817 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" podStartSLOduration=1.092797033 podStartE2EDuration="1.092797033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:00:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:00:53.088752316 +0000 UTC m=+1748.645668208" watchObservedRunningTime="2026-07-24 15:00:53.092797033 +0000 UTC m=+1748.649712929" Jul 24 15:00:53.423639 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.423614 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:53.569192 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569096 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-data\") pod \"2be27b98-86e8-42be-87ce-b9747b9664bd\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " Jul 24 15:00:53.569192 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569139 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2be27b98-86e8-42be-87ce-b9747b9664bd-istiod-ca-cert\") pod \"2be27b98-86e8-42be-87ce-b9747b9664bd\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " Jul 24 15:00:53.569192 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569157 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-workload-certs\") pod \"2be27b98-86e8-42be-87ce-b9747b9664bd\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " Jul 24 15:00:53.569192 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569185 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-token\") pod \"2be27b98-86e8-42be-87ce-b9747b9664bd\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " Jul 24 15:00:53.569864 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569275 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-envoy\") pod \"2be27b98-86e8-42be-87ce-b9747b9664bd\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " Jul 24 15:00:53.569864 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569302 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-workload-socket\") pod \"2be27b98-86e8-42be-87ce-b9747b9664bd\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " Jul 24 15:00:53.569864 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569335 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-credential-socket\") pod \"2be27b98-86e8-42be-87ce-b9747b9664bd\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " Jul 24 15:00:53.569864 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569396 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-podinfo\") pod \"2be27b98-86e8-42be-87ce-b9747b9664bd\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " Jul 24 15:00:53.569864 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569421 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jjvt\" (UniqueName: \"kubernetes.io/projected/2be27b98-86e8-42be-87ce-b9747b9664bd-kube-api-access-2jjvt\") pod \"2be27b98-86e8-42be-87ce-b9747b9664bd\" (UID: \"2be27b98-86e8-42be-87ce-b9747b9664bd\") " Jul 24 15:00:53.569864 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569443 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2be27b98-86e8-42be-87ce-b9747b9664bd" (UID: "2be27b98-86e8-42be-87ce-b9747b9664bd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:00:53.569864 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569639 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2be27b98-86e8-42be-87ce-b9747b9664bd" (UID: "2be27b98-86e8-42be-87ce-b9747b9664bd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:00:53.569864 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569683 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2be27b98-86e8-42be-87ce-b9747b9664bd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2be27b98-86e8-42be-87ce-b9747b9664bd" (UID: "2be27b98-86e8-42be-87ce-b9747b9664bd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:00:53.569864 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569685 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2be27b98-86e8-42be-87ce-b9747b9664bd" (UID: "2be27b98-86e8-42be-87ce-b9747b9664bd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:00:53.569864 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569824 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2be27b98-86e8-42be-87ce-b9747b9664bd-istiod-ca-cert\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:53.569864 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569844 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-workload-certs\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:53.569864 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569857 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-workload-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:53.569864 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.569870 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-credential-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:53.570548 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.570187 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-data" (OuterVolumeSpecName: "istio-data") pod "2be27b98-86e8-42be-87ce-b9747b9664bd" (UID: "2be27b98-86e8-42be-87ce-b9747b9664bd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:00:53.571800 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.571772 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2be27b98-86e8-42be-87ce-b9747b9664bd" (UID: "2be27b98-86e8-42be-87ce-b9747b9664bd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:00:53.571914 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.571820 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2be27b98-86e8-42be-87ce-b9747b9664bd" (UID: "2be27b98-86e8-42be-87ce-b9747b9664bd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 15:00:53.572089 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.572067 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2be27b98-86e8-42be-87ce-b9747b9664bd-kube-api-access-2jjvt" (OuterVolumeSpecName: "kube-api-access-2jjvt") pod "2be27b98-86e8-42be-87ce-b9747b9664bd" (UID: "2be27b98-86e8-42be-87ce-b9747b9664bd"). InnerVolumeSpecName "kube-api-access-2jjvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:00:53.572168 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.572097 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-token" (OuterVolumeSpecName: "istio-token") pod "2be27b98-86e8-42be-87ce-b9747b9664bd" (UID: "2be27b98-86e8-42be-87ce-b9747b9664bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:00:53.671021 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.670977 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-podinfo\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:53.671021 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.671019 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jjvt\" (UniqueName: \"kubernetes.io/projected/2be27b98-86e8-42be-87ce-b9747b9664bd-kube-api-access-2jjvt\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:53.671238 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.671036 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-data\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:53.671238 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.671049 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-token\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:53.671238 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:53.671062 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2be27b98-86e8-42be-87ce-b9747b9664bd-istio-envoy\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:00:54.044796 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:54.044762 2581 generic.go:356] "Generic (PLEG): container finished" podID="2be27b98-86e8-42be-87ce-b9747b9664bd" containerID="6d783b37e68ba53ba32eaccad6b794d15172d823ca5a925090e51952ac001099" exitCode=0 Jul 24 15:00:54.045001 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:54.044824 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" Jul 24 15:00:54.045001 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:54.044851 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" event={"ID":"2be27b98-86e8-42be-87ce-b9747b9664bd","Type":"ContainerDied","Data":"6d783b37e68ba53ba32eaccad6b794d15172d823ca5a925090e51952ac001099"} Jul 24 15:00:54.045001 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:54.044902 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl" event={"ID":"2be27b98-86e8-42be-87ce-b9747b9664bd","Type":"ContainerDied","Data":"e29eb090048f5c859253c9d76c4b81e497ea1fa86b8ea619b0aba0b1650b10f7"} Jul 24 15:00:54.045001 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:54.044924 2581 scope.go:117] "RemoveContainer" containerID="6d783b37e68ba53ba32eaccad6b794d15172d823ca5a925090e51952ac001099" Jul 24 15:00:54.056058 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:54.056036 2581 scope.go:117] "RemoveContainer" containerID="b899af8e31ba00216be78ab84ff9d842a2f01bb8a8f1a9433005dcee712050ee" Jul 24 15:00:54.064959 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:54.064941 2581 scope.go:117] "RemoveContainer" containerID="6d783b37e68ba53ba32eaccad6b794d15172d823ca5a925090e51952ac001099" Jul 24 15:00:54.065223 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:00:54.065206 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d783b37e68ba53ba32eaccad6b794d15172d823ca5a925090e51952ac001099\": container with ID starting with 6d783b37e68ba53ba32eaccad6b794d15172d823ca5a925090e51952ac001099 not found: ID does not exist" containerID="6d783b37e68ba53ba32eaccad6b794d15172d823ca5a925090e51952ac001099" Jul 24 15:00:54.065289 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:54.065233 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d783b37e68ba53ba32eaccad6b794d15172d823ca5a925090e51952ac001099"} err="failed to get container status \"6d783b37e68ba53ba32eaccad6b794d15172d823ca5a925090e51952ac001099\": rpc error: code = NotFound desc = could not find container \"6d783b37e68ba53ba32eaccad6b794d15172d823ca5a925090e51952ac001099\": container with ID starting with 6d783b37e68ba53ba32eaccad6b794d15172d823ca5a925090e51952ac001099 not found: ID does not exist" Jul 24 15:00:54.065289 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:54.065253 2581 scope.go:117] "RemoveContainer" containerID="b899af8e31ba00216be78ab84ff9d842a2f01bb8a8f1a9433005dcee712050ee" Jul 24 15:00:54.065520 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:00:54.065502 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b899af8e31ba00216be78ab84ff9d842a2f01bb8a8f1a9433005dcee712050ee\": container with ID starting with b899af8e31ba00216be78ab84ff9d842a2f01bb8a8f1a9433005dcee712050ee not found: ID does not exist" containerID="b899af8e31ba00216be78ab84ff9d842a2f01bb8a8f1a9433005dcee712050ee" Jul 24 15:00:54.065617 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:54.065554 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b899af8e31ba00216be78ab84ff9d842a2f01bb8a8f1a9433005dcee712050ee"} err="failed to get container status \"b899af8e31ba00216be78ab84ff9d842a2f01bb8a8f1a9433005dcee712050ee\": rpc error: code = NotFound desc = could not find container \"b899af8e31ba00216be78ab84ff9d842a2f01bb8a8f1a9433005dcee712050ee\": container with ID starting with b899af8e31ba00216be78ab84ff9d842a2f01bb8a8f1a9433005dcee712050ee not found: ID does not exist" Jul 24 15:00:54.073138 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:54.073111 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl"] Jul 24 15:00:54.074986 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:54.074962 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4c7371ad-openshift-default-544f5dc58d-fb8sl"] Jul 24 15:00:54.972946 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:00:54.972914 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2be27b98-86e8-42be-87ce-b9747b9664bd" path="/var/lib/kubelet/pods/2be27b98-86e8-42be-87ce-b9747b9664bd/volumes" Jul 24 15:01:04.048076 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:04.048045 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" Jul 24 15:01:05.109088 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:05.109054 2581 generic.go:356] "Generic (PLEG): container finished" podID="fc1fbbfc-91db-4979-bd86-e526b3e9765e" containerID="d17467f36609ab8b75830ef89aa5b1da322e9773238121481e07bf4aa88e06d3" exitCode=0 Jul 24 15:01:05.109517 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:05.109129 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" event={"ID":"fc1fbbfc-91db-4979-bd86-e526b3e9765e","Type":"ContainerDied","Data":"d17467f36609ab8b75830ef89aa5b1da322e9773238121481e07bf4aa88e06d3"} Jul 24 15:01:05.109593 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:05.109558 2581 scope.go:117] "RemoveContainer" containerID="d17467f36609ab8b75830ef89aa5b1da322e9773238121481e07bf4aa88e06d3" Jul 24 15:01:05.110677 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:05.110649 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:01:05.110745 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:05.110734 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:01:05.110794 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:05.110780 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:01:06.026673 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:06.026628 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:01:06.116808 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:06.116776 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" event={"ID":"fc1fbbfc-91db-4979-bd86-e526b3e9765e","Type":"ContainerStarted","Data":"f3a9713f10727bf9d631b8dbd16baa6a04320b9f4f66063a85d62c3b3028201c"} Jul 24 15:01:06.353066 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:06.353021 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:01:06.354594 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:06.354562 2581 patch_prober.go:28] interesting pod/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 24 15:01:06.354922 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:06.354891 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" podUID="fc1fbbfc-91db-4979-bd86-e526b3e9765e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 24 15:01:07.353442 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:07.353396 2581 patch_prober.go:28] interesting pod/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 24 15:01:07.353984 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:07.353475 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" podUID="fc1fbbfc-91db-4979-bd86-e526b3e9765e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 24 15:01:08.352749 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:08.352708 2581 patch_prober.go:28] interesting pod/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 24 15:01:08.353036 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:08.353003 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" podUID="fc1fbbfc-91db-4979-bd86-e526b3e9765e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 24 15:01:09.353204 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:09.353163 2581 patch_prober.go:28] interesting pod/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 24 15:01:09.353845 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:09.353810 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" podUID="fc1fbbfc-91db-4979-bd86-e526b3e9765e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 24 15:01:10.357735 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:10.357704 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:01:10.358158 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:10.357972 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:01:10.358689 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:10.358666 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:01:27.242320 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:27.242280 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9"] Jul 24 15:01:27.242872 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:27.242563 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" podUID="70104359-4ce0-4d04-9665-6e433661c2bb" containerName="payload-pre-processing" containerID="cri-o://0602d95040647313923a6c02080c3032960ad54b7935841caa24922547dc8c96" gracePeriod=30 Jul 24 15:01:27.500751 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:27.500688 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" Jul 24 15:01:27.591936 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:27.591906 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70104359-4ce0-4d04-9665-6e433661c2bb-plugins-config-volume\") pod \"70104359-4ce0-4d04-9665-6e433661c2bb\" (UID: \"70104359-4ce0-4d04-9665-6e433661c2bb\") " Jul 24 15:01:27.592106 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:27.591977 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw78d\" (UniqueName: \"kubernetes.io/projected/70104359-4ce0-4d04-9665-6e433661c2bb-kube-api-access-rw78d\") pod \"70104359-4ce0-4d04-9665-6e433661c2bb\" (UID: \"70104359-4ce0-4d04-9665-6e433661c2bb\") " Jul 24 15:01:27.592337 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:27.592311 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70104359-4ce0-4d04-9665-6e433661c2bb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "70104359-4ce0-4d04-9665-6e433661c2bb" (UID: "70104359-4ce0-4d04-9665-6e433661c2bb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:01:27.594070 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:27.594048 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70104359-4ce0-4d04-9665-6e433661c2bb-kube-api-access-rw78d" (OuterVolumeSpecName: "kube-api-access-rw78d") pod "70104359-4ce0-4d04-9665-6e433661c2bb" (UID: "70104359-4ce0-4d04-9665-6e433661c2bb"). InnerVolumeSpecName "kube-api-access-rw78d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:01:27.693427 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:27.693390 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw78d\" (UniqueName: \"kubernetes.io/projected/70104359-4ce0-4d04-9665-6e433661c2bb-kube-api-access-rw78d\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:01:27.693427 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:27.693419 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70104359-4ce0-4d04-9665-6e433661c2bb-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:01:28.236830 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:28.236793 2581 generic.go:356] "Generic (PLEG): container finished" podID="70104359-4ce0-4d04-9665-6e433661c2bb" containerID="0602d95040647313923a6c02080c3032960ad54b7935841caa24922547dc8c96" exitCode=0 Jul 24 15:01:28.237023 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:28.236839 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" Jul 24 15:01:28.237023 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:28.236877 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" event={"ID":"70104359-4ce0-4d04-9665-6e433661c2bb","Type":"ContainerDied","Data":"0602d95040647313923a6c02080c3032960ad54b7935841caa24922547dc8c96"} Jul 24 15:01:28.237023 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:28.236933 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9" event={"ID":"70104359-4ce0-4d04-9665-6e433661c2bb","Type":"ContainerDied","Data":"8956599e763fafb5cf00f3607ac83de7ca320a910f8be45aa6918ba8e361ba61"} Jul 24 15:01:28.237023 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:28.236956 2581 scope.go:117] "RemoveContainer" containerID="0602d95040647313923a6c02080c3032960ad54b7935841caa24922547dc8c96" Jul 24 15:01:28.246061 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:28.245871 2581 scope.go:117] "RemoveContainer" containerID="0602d95040647313923a6c02080c3032960ad54b7935841caa24922547dc8c96" Jul 24 15:01:28.246346 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:01:28.246152 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0602d95040647313923a6c02080c3032960ad54b7935841caa24922547dc8c96\": container with ID starting with 0602d95040647313923a6c02080c3032960ad54b7935841caa24922547dc8c96 not found: ID does not exist" containerID="0602d95040647313923a6c02080c3032960ad54b7935841caa24922547dc8c96" Jul 24 15:01:28.246346 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:28.246179 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0602d95040647313923a6c02080c3032960ad54b7935841caa24922547dc8c96"} err="failed to get container status \"0602d95040647313923a6c02080c3032960ad54b7935841caa24922547dc8c96\": rpc error: code = NotFound desc = could not find container \"0602d95040647313923a6c02080c3032960ad54b7935841caa24922547dc8c96\": container with ID starting with 0602d95040647313923a6c02080c3032960ad54b7935841caa24922547dc8c96 not found: ID does not exist" Jul 24 15:01:28.263554 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:28.263498 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9"] Jul 24 15:01:28.269852 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:28.269825 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2feafa84-6bfdf796d4-s84j9"] Jul 24 15:01:28.972439 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:28.972402 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70104359-4ce0-4d04-9665-6e433661c2bb" path="/var/lib/kubelet/pods/70104359-4ce0-4d04-9665-6e433661c2bb/volumes" Jul 24 15:01:31.692214 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:31.692180 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx"] Jul 24 15:01:31.692752 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:31.692398 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" podUID="fc1fbbfc-91db-4979-bd86-e526b3e9765e" containerName="istio-proxy" containerID="cri-o://f3a9713f10727bf9d631b8dbd16baa6a04320b9f4f66063a85d62c3b3028201c" gracePeriod=30 Jul 24 15:01:36.963428 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:36.963358 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:01:37.085916 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.085876 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8cjr\" (UniqueName: \"kubernetes.io/projected/fc1fbbfc-91db-4979-bd86-e526b3e9765e-kube-api-access-z8cjr\") pod \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " Jul 24 15:01:37.086121 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.085927 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-workload-socket\") pod \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " Jul 24 15:01:37.086121 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.085965 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istiod-ca-cert\") pod \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " Jul 24 15:01:37.086121 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.086002 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-token\") pod \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " Jul 24 15:01:37.086121 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.086027 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-workload-certs\") pod \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " Jul 24 15:01:37.086121 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.086048 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-credential-socket\") pod \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " Jul 24 15:01:37.086121 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.086100 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-envoy\") pod \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " Jul 24 15:01:37.086436 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.086145 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-podinfo\") pod \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " Jul 24 15:01:37.086436 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.086191 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-data\") pod \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\" (UID: \"fc1fbbfc-91db-4979-bd86-e526b3e9765e\") " Jul 24 15:01:37.086572 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.086501 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc1fbbfc-91db-4979-bd86-e526b3e9765e" (UID: "fc1fbbfc-91db-4979-bd86-e526b3e9765e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:01:37.086635 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.086562 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc1fbbfc-91db-4979-bd86-e526b3e9765e" (UID: "fc1fbbfc-91db-4979-bd86-e526b3e9765e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:01:37.086703 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.086625 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc1fbbfc-91db-4979-bd86-e526b3e9765e" (UID: "fc1fbbfc-91db-4979-bd86-e526b3e9765e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:01:37.086760 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.086712 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc1fbbfc-91db-4979-bd86-e526b3e9765e" (UID: "fc1fbbfc-91db-4979-bd86-e526b3e9765e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:01:37.087694 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.087663 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc1fbbfc-91db-4979-bd86-e526b3e9765e" (UID: "fc1fbbfc-91db-4979-bd86-e526b3e9765e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:01:37.088407 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.088382 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc1fbbfc-91db-4979-bd86-e526b3e9765e-kube-api-access-z8cjr" (OuterVolumeSpecName: "kube-api-access-z8cjr") pod "fc1fbbfc-91db-4979-bd86-e526b3e9765e" (UID: "fc1fbbfc-91db-4979-bd86-e526b3e9765e"). InnerVolumeSpecName "kube-api-access-z8cjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:01:37.088655 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.088626 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc1fbbfc-91db-4979-bd86-e526b3e9765e" (UID: "fc1fbbfc-91db-4979-bd86-e526b3e9765e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 15:01:37.088819 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.088796 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc1fbbfc-91db-4979-bd86-e526b3e9765e" (UID: "fc1fbbfc-91db-4979-bd86-e526b3e9765e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:01:37.088959 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.088937 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc1fbbfc-91db-4979-bd86-e526b3e9765e" (UID: "fc1fbbfc-91db-4979-bd86-e526b3e9765e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:01:37.187370 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.187317 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-podinfo\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:01:37.187370 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.187365 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-data\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:01:37.187370 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.187375 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8cjr\" (UniqueName: \"kubernetes.io/projected/fc1fbbfc-91db-4979-bd86-e526b3e9765e-kube-api-access-z8cjr\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:01:37.187370 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.187386 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-workload-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:01:37.187370 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.187394 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istiod-ca-cert\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:01:37.187721 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.187402 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-token\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:01:37.187721 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.187410 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-workload-certs\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:01:37.187721 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.187417 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-credential-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:01:37.187721 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.187424 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1fbbfc-91db-4979-bd86-e526b3e9765e-istio-envoy\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:01:37.287139 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.287104 2581 generic.go:356] "Generic (PLEG): container finished" podID="fc1fbbfc-91db-4979-bd86-e526b3e9765e" containerID="f3a9713f10727bf9d631b8dbd16baa6a04320b9f4f66063a85d62c3b3028201c" exitCode=0 Jul 24 15:01:37.287307 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.287165 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" Jul 24 15:01:37.287307 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.287185 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" event={"ID":"fc1fbbfc-91db-4979-bd86-e526b3e9765e","Type":"ContainerDied","Data":"f3a9713f10727bf9d631b8dbd16baa6a04320b9f4f66063a85d62c3b3028201c"} Jul 24 15:01:37.287307 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.287244 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx" event={"ID":"fc1fbbfc-91db-4979-bd86-e526b3e9765e","Type":"ContainerDied","Data":"50512add1c4b269878de678bba8cbf7144185f395bbeab70d73fdca9cd004bc4"} Jul 24 15:01:37.287307 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.287266 2581 scope.go:117] "RemoveContainer" containerID="f3a9713f10727bf9d631b8dbd16baa6a04320b9f4f66063a85d62c3b3028201c" Jul 24 15:01:37.297112 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.297089 2581 scope.go:117] "RemoveContainer" containerID="d17467f36609ab8b75830ef89aa5b1da322e9773238121481e07bf4aa88e06d3" Jul 24 15:01:37.305693 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.305673 2581 scope.go:117] "RemoveContainer" containerID="f3a9713f10727bf9d631b8dbd16baa6a04320b9f4f66063a85d62c3b3028201c" Jul 24 15:01:37.305931 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:01:37.305911 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3a9713f10727bf9d631b8dbd16baa6a04320b9f4f66063a85d62c3b3028201c\": container with ID starting with f3a9713f10727bf9d631b8dbd16baa6a04320b9f4f66063a85d62c3b3028201c not found: ID does not exist" containerID="f3a9713f10727bf9d631b8dbd16baa6a04320b9f4f66063a85d62c3b3028201c" Jul 24 15:01:37.305978 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.305942 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a9713f10727bf9d631b8dbd16baa6a04320b9f4f66063a85d62c3b3028201c"} err="failed to get container status \"f3a9713f10727bf9d631b8dbd16baa6a04320b9f4f66063a85d62c3b3028201c\": rpc error: code = NotFound desc = could not find container \"f3a9713f10727bf9d631b8dbd16baa6a04320b9f4f66063a85d62c3b3028201c\": container with ID starting with f3a9713f10727bf9d631b8dbd16baa6a04320b9f4f66063a85d62c3b3028201c not found: ID does not exist" Jul 24 15:01:37.305978 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.305959 2581 scope.go:117] "RemoveContainer" containerID="d17467f36609ab8b75830ef89aa5b1da322e9773238121481e07bf4aa88e06d3" Jul 24 15:01:37.306180 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:01:37.306161 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d17467f36609ab8b75830ef89aa5b1da322e9773238121481e07bf4aa88e06d3\": container with ID starting with d17467f36609ab8b75830ef89aa5b1da322e9773238121481e07bf4aa88e06d3 not found: ID does not exist" containerID="d17467f36609ab8b75830ef89aa5b1da322e9773238121481e07bf4aa88e06d3" Jul 24 15:01:37.306224 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.306186 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d17467f36609ab8b75830ef89aa5b1da322e9773238121481e07bf4aa88e06d3"} err="failed to get container status \"d17467f36609ab8b75830ef89aa5b1da322e9773238121481e07bf4aa88e06d3\": rpc error: code = NotFound desc = could not find container \"d17467f36609ab8b75830ef89aa5b1da322e9773238121481e07bf4aa88e06d3\": container with ID starting with d17467f36609ab8b75830ef89aa5b1da322e9773238121481e07bf4aa88e06d3 not found: ID does not exist" Jul 24 15:01:37.314580 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.314551 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx"] Jul 24 15:01:37.316657 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:37.316638 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-2feafa84-openshift-default-66598fcfb-txqnx"] Jul 24 15:01:38.972551 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:38.972490 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc1fbbfc-91db-4979-bd86-e526b3e9765e" path="/var/lib/kubelet/pods/fc1fbbfc-91db-4979-bd86-e526b3e9765e/volumes" Jul 24 15:01:45.032745 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:45.032715 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 15:01:45.035501 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:45.035474 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 15:01:45.040765 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:45.040742 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 15:01:45.043122 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:01:45.043103 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 15:03:19.120482 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.120401 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s"] Jul 24 15:03:19.120963 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.120817 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2be27b98-86e8-42be-87ce-b9747b9664bd" containerName="istio-proxy" Jul 24 15:03:19.120963 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.120829 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2be27b98-86e8-42be-87ce-b9747b9664bd" containerName="istio-proxy" Jul 24 15:03:19.120963 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.120838 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2be27b98-86e8-42be-87ce-b9747b9664bd" containerName="istio-proxy" Jul 24 15:03:19.120963 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.120843 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2be27b98-86e8-42be-87ce-b9747b9664bd" containerName="istio-proxy" Jul 24 15:03:19.120963 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.120856 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70104359-4ce0-4d04-9665-6e433661c2bb" containerName="payload-pre-processing" Jul 24 15:03:19.120963 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.120864 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="70104359-4ce0-4d04-9665-6e433661c2bb" containerName="payload-pre-processing" Jul 24 15:03:19.120963 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.120878 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1fbbfc-91db-4979-bd86-e526b3e9765e" containerName="istio-proxy" Jul 24 15:03:19.120963 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.120884 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1fbbfc-91db-4979-bd86-e526b3e9765e" containerName="istio-proxy" Jul 24 15:03:19.120963 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.120900 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1fbbfc-91db-4979-bd86-e526b3e9765e" containerName="istio-proxy" Jul 24 15:03:19.120963 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.120905 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1fbbfc-91db-4979-bd86-e526b3e9765e" containerName="istio-proxy" Jul 24 15:03:19.121271 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.120968 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2be27b98-86e8-42be-87ce-b9747b9664bd" containerName="istio-proxy" Jul 24 15:03:19.121271 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.120979 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc1fbbfc-91db-4979-bd86-e526b3e9765e" containerName="istio-proxy" Jul 24 15:03:19.121271 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.120985 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="70104359-4ce0-4d04-9665-6e433661c2bb" containerName="payload-pre-processing" Jul 24 15:03:19.121271 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.120992 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc1fbbfc-91db-4979-bd86-e526b3e9765e" containerName="istio-proxy" Jul 24 15:03:19.123169 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.123151 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.128221 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.128196 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6726d865-openshift-default-dockercfg-d2bfj\"" Jul 24 15:03:19.164922 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.164886 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s"] Jul 24 15:03:19.227988 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.227947 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-istio-data\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.228171 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.228019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-istio-envoy\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.228171 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.228064 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-workload-certs\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.228171 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.228154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d656a005-41af-4924-b034-08b3e319b399-istio-token\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.228307 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.228207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d656a005-41af-4924-b034-08b3e319b399-istio-podinfo\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.228307 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.228245 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lghp\" (UniqueName: \"kubernetes.io/projected/d656a005-41af-4924-b034-08b3e319b399-kube-api-access-8lghp\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.228404 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.228326 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d656a005-41af-4924-b034-08b3e319b399-istiod-ca-cert\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.228462 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.228398 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-credential-socket\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.228462 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.228434 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-workload-socket\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.329995 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.329954 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d656a005-41af-4924-b034-08b3e319b399-istiod-ca-cert\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.330207 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.330016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-credential-socket\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.330207 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.330049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-workload-socket\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.330207 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.330080 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-istio-data\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.330207 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.330139 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-istio-envoy\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.330207 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.330170 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-workload-certs\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.330483 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.330230 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d656a005-41af-4924-b034-08b3e319b399-istio-token\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.330483 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.330272 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d656a005-41af-4924-b034-08b3e319b399-istio-podinfo\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.330483 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.330304 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lghp\" (UniqueName: \"kubernetes.io/projected/d656a005-41af-4924-b034-08b3e319b399-kube-api-access-8lghp\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.330483 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.330438 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-credential-socket\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.330820 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.330799 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-workload-socket\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.331070 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.331045 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-workload-certs\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.331186 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.331165 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d656a005-41af-4924-b034-08b3e319b399-istiod-ca-cert\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.331484 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.331459 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-istio-data\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.333723 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.333692 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-istio-envoy\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.333895 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.333873 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d656a005-41af-4924-b034-08b3e319b399-istio-podinfo\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.345863 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.345827 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d656a005-41af-4924-b034-08b3e319b399-istio-token\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.345985 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.345928 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lghp\" (UniqueName: \"kubernetes.io/projected/d656a005-41af-4924-b034-08b3e319b399-kube-api-access-8lghp\") pod \"e2e-mt-6726d865-openshift-default-565c599dbd-rst2s\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.434454 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.434370 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:19.593876 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:03:19.593839 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd656a005_41af_4924_b034_08b3e319b399.slice/crio-0cecacce5d26305e74d8c3b1cf64857cc001c96a241f4fab2a14e8f2ed589be0 WatchSource:0}: Error finding container 0cecacce5d26305e74d8c3b1cf64857cc001c96a241f4fab2a14e8f2ed589be0: Status 404 returned error can't find the container with id 0cecacce5d26305e74d8c3b1cf64857cc001c96a241f4fab2a14e8f2ed589be0 Jul 24 15:03:19.593998 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.593899 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s"] Jul 24 15:03:19.595889 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.595857 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:03:19.595964 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.595925 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:03:19.595964 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.595953 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:03:19.820543 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.820484 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" event={"ID":"d656a005-41af-4924-b034-08b3e319b399","Type":"ContainerStarted","Data":"2a2743d67905e49304fd812a52bf3822777fbd19fc552b2be3392a360dacb97c"} Jul 24 15:03:19.820721 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:19.820566 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" event={"ID":"d656a005-41af-4924-b034-08b3e319b399","Type":"ContainerStarted","Data":"0cecacce5d26305e74d8c3b1cf64857cc001c96a241f4fab2a14e8f2ed589be0"} Jul 24 15:03:20.435323 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:20.435283 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:20.440296 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:20.440268 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:20.477745 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:20.477685 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" podStartSLOduration=1.477666665 podStartE2EDuration="1.477666665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:03:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:03:19.850773744 +0000 UTC m=+1895.407689639" watchObservedRunningTime="2026-07-24 15:03:20.477666665 +0000 UTC m=+1896.034582606" Jul 24 15:03:20.825807 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:20.825772 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:20.826842 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:20.826819 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:24.447792 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.447756 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8"] Jul 24 15:03:24.448203 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.448190 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2be27b98-86e8-42be-87ce-b9747b9664bd" containerName="istio-proxy" Jul 24 15:03:24.450282 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.450264 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" Jul 24 15:03:24.468101 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.468080 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-6726d865\"" Jul 24 15:03:24.468899 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.468884 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-6726d865-dockercfg-88mtm\"" Jul 24 15:03:24.485942 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.485903 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48rjc\" (UniqueName: \"kubernetes.io/projected/67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a-kube-api-access-48rjc\") pod \"payload-processing-e2e-mt-6726d865-5f5466558b-th2p8\" (UID: \"67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a\") " pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" Jul 24 15:03:24.486143 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.485996 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a-plugins-config-volume\") pod \"payload-processing-e2e-mt-6726d865-5f5466558b-th2p8\" (UID: \"67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a\") " pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" Jul 24 15:03:24.498058 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.498026 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8"] Jul 24 15:03:24.587476 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.587431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a-plugins-config-volume\") pod \"payload-processing-e2e-mt-6726d865-5f5466558b-th2p8\" (UID: \"67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a\") " pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" Jul 24 15:03:24.587696 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.587583 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48rjc\" (UniqueName: \"kubernetes.io/projected/67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a-kube-api-access-48rjc\") pod \"payload-processing-e2e-mt-6726d865-5f5466558b-th2p8\" (UID: \"67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a\") " pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" Jul 24 15:03:24.588627 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.588571 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a-plugins-config-volume\") pod \"payload-processing-e2e-mt-6726d865-5f5466558b-th2p8\" (UID: \"67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a\") " pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" Jul 24 15:03:24.591135 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.591112 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2"] Jul 24 15:03:24.594193 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.594167 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" Jul 24 15:03:24.608797 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.608772 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2"] Jul 24 15:03:24.630289 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.630257 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48rjc\" (UniqueName: \"kubernetes.io/projected/67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a-kube-api-access-48rjc\") pod \"payload-processing-e2e-mt-6726d865-5f5466558b-th2p8\" (UID: \"67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a\") " pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" Jul 24 15:03:24.688239 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.688200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkh5x\" (UniqueName: \"kubernetes.io/projected/4762ea53-6a84-4769-baf1-3b8b8066aea1-kube-api-access-jkh5x\") pod \"payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2\" (UID: \"4762ea53-6a84-4769-baf1-3b8b8066aea1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" Jul 24 15:03:24.688410 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.688258 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4762ea53-6a84-4769-baf1-3b8b8066aea1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2\" (UID: \"4762ea53-6a84-4769-baf1-3b8b8066aea1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" Jul 24 15:03:24.761292 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.761200 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" Jul 24 15:03:24.789866 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.789834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkh5x\" (UniqueName: \"kubernetes.io/projected/4762ea53-6a84-4769-baf1-3b8b8066aea1-kube-api-access-jkh5x\") pod \"payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2\" (UID: \"4762ea53-6a84-4769-baf1-3b8b8066aea1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" Jul 24 15:03:24.790026 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.789892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4762ea53-6a84-4769-baf1-3b8b8066aea1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2\" (UID: \"4762ea53-6a84-4769-baf1-3b8b8066aea1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" Jul 24 15:03:24.790564 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.790511 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4762ea53-6a84-4769-baf1-3b8b8066aea1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2\" (UID: \"4762ea53-6a84-4769-baf1-3b8b8066aea1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" Jul 24 15:03:24.802729 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.802675 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkh5x\" (UniqueName: \"kubernetes.io/projected/4762ea53-6a84-4769-baf1-3b8b8066aea1-kube-api-access-jkh5x\") pod \"payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2\" (UID: \"4762ea53-6a84-4769-baf1-3b8b8066aea1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" Jul 24 15:03:24.910371 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:24.910336 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" Jul 24 15:03:25.130682 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:25.130664 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8"] Jul 24 15:03:25.133001 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:03:25.132972 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67160bb3_ec13_4ac0_8ad6_b8d1eb99cb1a.slice/crio-b7ad24000fa8097eb699186d2160f45cd9498a9db7dbd62457b7a148a63e1a7a WatchSource:0}: Error finding container b7ad24000fa8097eb699186d2160f45cd9498a9db7dbd62457b7a148a63e1a7a: Status 404 returned error can't find the container with id b7ad24000fa8097eb699186d2160f45cd9498a9db7dbd62457b7a148a63e1a7a Jul 24 15:03:25.271719 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:25.271688 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2"] Jul 24 15:03:25.275010 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:03:25.274986 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4762ea53_6a84_4769_baf1_3b8b8066aea1.slice/crio-b87713f21c1b7a2b16f3c784f545bf64134e79f4ece5e28cc80c5a8d7ac08a3d WatchSource:0}: Error finding container b87713f21c1b7a2b16f3c784f545bf64134e79f4ece5e28cc80c5a8d7ac08a3d: Status 404 returned error can't find the container with id b87713f21c1b7a2b16f3c784f545bf64134e79f4ece5e28cc80c5a8d7ac08a3d Jul 24 15:03:25.857331 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:25.857291 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" event={"ID":"4762ea53-6a84-4769-baf1-3b8b8066aea1","Type":"ContainerStarted","Data":"acc0b2f274dfd0bfe3c3d52ffffd335f7ca6ff6cfc5d90cbb099159e9a19bd39"} Jul 24 15:03:25.857831 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:25.857355 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" event={"ID":"4762ea53-6a84-4769-baf1-3b8b8066aea1","Type":"ContainerStarted","Data":"b87713f21c1b7a2b16f3c784f545bf64134e79f4ece5e28cc80c5a8d7ac08a3d"} Jul 24 15:03:25.857831 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:25.857386 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" Jul 24 15:03:25.858974 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:25.858948 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" event={"ID":"67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a","Type":"ContainerStarted","Data":"df2ec03e9c1a71446b0ce55183cc9b990e4b43eb7aa126a0f07917415394c84f"} Jul 24 15:03:25.859077 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:25.858992 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" event={"ID":"67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a","Type":"ContainerStarted","Data":"b7ad24000fa8097eb699186d2160f45cd9498a9db7dbd62457b7a148a63e1a7a"} Jul 24 15:03:25.859077 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:25.859031 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" Jul 24 15:03:25.895016 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:25.894963 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" podStartSLOduration=1.894946702 podStartE2EDuration="1.894946702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:03:25.888028819 +0000 UTC m=+1901.444944711" watchObservedRunningTime="2026-07-24 15:03:25.894946702 +0000 UTC m=+1901.451862593" Jul 24 15:03:25.921804 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:25.921757 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" podStartSLOduration=1.9217402670000001 podStartE2EDuration="1.921740267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:03:25.920040193 +0000 UTC m=+1901.476956086" watchObservedRunningTime="2026-07-24 15:03:25.921740267 +0000 UTC m=+1901.478656158" Jul 24 15:03:36.867740 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:36.867692 2581 patch_prober.go:28] interesting pod/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 24 15:03:36.868263 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:36.867771 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" podUID="d656a005-41af-4924-b034-08b3e319b399" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 24 15:03:36.868975 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:36.868954 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" Jul 24 15:03:36.869074 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:36.869020 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" Jul 24 15:03:37.926035 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:37.925950 2581 generic.go:356] "Generic (PLEG): container finished" podID="d656a005-41af-4924-b034-08b3e319b399" containerID="2a2743d67905e49304fd812a52bf3822777fbd19fc552b2be3392a360dacb97c" exitCode=0 Jul 24 15:03:37.926457 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:37.926033 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" event={"ID":"d656a005-41af-4924-b034-08b3e319b399","Type":"ContainerDied","Data":"2a2743d67905e49304fd812a52bf3822777fbd19fc552b2be3392a360dacb97c"} Jul 24 15:03:37.926501 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:37.926469 2581 scope.go:117] "RemoveContainer" containerID="2a2743d67905e49304fd812a52bf3822777fbd19fc552b2be3392a360dacb97c" Jul 24 15:03:37.927515 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:37.927479 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:03:37.927652 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:37.927587 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:03:37.927652 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:37.927637 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:03:38.938854 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:38.938817 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" event={"ID":"d656a005-41af-4924-b034-08b3e319b399","Type":"ContainerStarted","Data":"4ba8f395da75d1735c127599f8ef21ee4034bf28c578693dbc201e2dcdc727e9"} Jul 24 15:03:39.435297 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:39.435255 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:39.435569 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:39.435518 2581 patch_prober.go:28] interesting pod/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 24 15:03:39.435624 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:39.435608 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" podUID="d656a005-41af-4924-b034-08b3e319b399" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 24 15:03:40.434824 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:40.434780 2581 patch_prober.go:28] interesting pod/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 24 15:03:40.435302 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:40.434844 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" podUID="d656a005-41af-4924-b034-08b3e319b399" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 24 15:03:41.435577 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:41.435509 2581 patch_prober.go:28] interesting pod/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 24 15:03:41.436069 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:41.435603 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" podUID="d656a005-41af-4924-b034-08b3e319b399" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 24 15:03:42.435824 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:42.435785 2581 patch_prober.go:28] interesting pod/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 24 15:03:42.436255 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:42.435847 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" podUID="d656a005-41af-4924-b034-08b3e319b399" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 24 15:03:43.439635 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:43.439604 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:43.440026 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:43.439861 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:43.440516 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:43.440499 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:03:45.025861 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.025821 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8"] Jul 24 15:03:45.026323 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.026083 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" podUID="67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a" containerName="payload-processing" containerID="cri-o://df2ec03e9c1a71446b0ce55183cc9b990e4b43eb7aa126a0f07917415394c84f" gracePeriod=30 Jul 24 15:03:45.033983 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.033515 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2"] Jul 24 15:03:45.033983 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.033876 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" podUID="4762ea53-6a84-4769-baf1-3b8b8066aea1" containerName="payload-pre-processing" containerID="cri-o://acc0b2f274dfd0bfe3c3d52ffffd335f7ca6ff6cfc5d90cbb099159e9a19bd39" gracePeriod=30 Jul 24 15:03:45.293874 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.293850 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" Jul 24 15:03:45.329594 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.329568 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" Jul 24 15:03:45.399191 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.399160 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a-plugins-config-volume\") pod \"67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a\" (UID: \"67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a\") " Jul 24 15:03:45.399396 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.399306 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48rjc\" (UniqueName: \"kubernetes.io/projected/67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a-kube-api-access-48rjc\") pod \"67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a\" (UID: \"67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a\") " Jul 24 15:03:45.399600 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.399578 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a" (UID: "67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:03:45.401305 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.401277 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a-kube-api-access-48rjc" (OuterVolumeSpecName: "kube-api-access-48rjc") pod "67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a" (UID: "67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a"). InnerVolumeSpecName "kube-api-access-48rjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:03:45.500900 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.500866 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkh5x\" (UniqueName: \"kubernetes.io/projected/4762ea53-6a84-4769-baf1-3b8b8066aea1-kube-api-access-jkh5x\") pod \"4762ea53-6a84-4769-baf1-3b8b8066aea1\" (UID: \"4762ea53-6a84-4769-baf1-3b8b8066aea1\") " Jul 24 15:03:45.501085 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.501006 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4762ea53-6a84-4769-baf1-3b8b8066aea1-plugins-config-volume\") pod \"4762ea53-6a84-4769-baf1-3b8b8066aea1\" (UID: \"4762ea53-6a84-4769-baf1-3b8b8066aea1\") " Jul 24 15:03:45.501351 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.501332 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48rjc\" (UniqueName: \"kubernetes.io/projected/67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a-kube-api-access-48rjc\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:03:45.501430 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.501352 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:03:45.501430 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.501367 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4762ea53-6a84-4769-baf1-3b8b8066aea1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4762ea53-6a84-4769-baf1-3b8b8066aea1" (UID: "4762ea53-6a84-4769-baf1-3b8b8066aea1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:03:45.503011 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.502990 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4762ea53-6a84-4769-baf1-3b8b8066aea1-kube-api-access-jkh5x" (OuterVolumeSpecName: "kube-api-access-jkh5x") pod "4762ea53-6a84-4769-baf1-3b8b8066aea1" (UID: "4762ea53-6a84-4769-baf1-3b8b8066aea1"). InnerVolumeSpecName "kube-api-access-jkh5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:03:45.601967 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.601934 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkh5x\" (UniqueName: \"kubernetes.io/projected/4762ea53-6a84-4769-baf1-3b8b8066aea1-kube-api-access-jkh5x\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:03:45.601967 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.601964 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4762ea53-6a84-4769-baf1-3b8b8066aea1-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:03:45.983141 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.983104 2581 generic.go:356] "Generic (PLEG): container finished" podID="67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a" containerID="df2ec03e9c1a71446b0ce55183cc9b990e4b43eb7aa126a0f07917415394c84f" exitCode=0 Jul 24 15:03:45.983357 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.983172 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" Jul 24 15:03:45.983357 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.983184 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" event={"ID":"67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a","Type":"ContainerDied","Data":"df2ec03e9c1a71446b0ce55183cc9b990e4b43eb7aa126a0f07917415394c84f"} Jul 24 15:03:45.983357 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.983247 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8" event={"ID":"67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a","Type":"ContainerDied","Data":"b7ad24000fa8097eb699186d2160f45cd9498a9db7dbd62457b7a148a63e1a7a"} Jul 24 15:03:45.983357 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.983284 2581 scope.go:117] "RemoveContainer" containerID="df2ec03e9c1a71446b0ce55183cc9b990e4b43eb7aa126a0f07917415394c84f" Jul 24 15:03:45.984950 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.984926 2581 generic.go:356] "Generic (PLEG): container finished" podID="4762ea53-6a84-4769-baf1-3b8b8066aea1" containerID="acc0b2f274dfd0bfe3c3d52ffffd335f7ca6ff6cfc5d90cbb099159e9a19bd39" exitCode=0 Jul 24 15:03:45.985096 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.984958 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" event={"ID":"4762ea53-6a84-4769-baf1-3b8b8066aea1","Type":"ContainerDied","Data":"acc0b2f274dfd0bfe3c3d52ffffd335f7ca6ff6cfc5d90cbb099159e9a19bd39"} Jul 24 15:03:45.985096 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.984992 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" event={"ID":"4762ea53-6a84-4769-baf1-3b8b8066aea1","Type":"ContainerDied","Data":"b87713f21c1b7a2b16f3c784f545bf64134e79f4ece5e28cc80c5a8d7ac08a3d"} Jul 24 15:03:45.985096 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.984995 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2" Jul 24 15:03:45.992929 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.992907 2581 scope.go:117] "RemoveContainer" containerID="df2ec03e9c1a71446b0ce55183cc9b990e4b43eb7aa126a0f07917415394c84f" Jul 24 15:03:45.993236 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:03:45.993211 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df2ec03e9c1a71446b0ce55183cc9b990e4b43eb7aa126a0f07917415394c84f\": container with ID starting with df2ec03e9c1a71446b0ce55183cc9b990e4b43eb7aa126a0f07917415394c84f not found: ID does not exist" containerID="df2ec03e9c1a71446b0ce55183cc9b990e4b43eb7aa126a0f07917415394c84f" Jul 24 15:03:45.993305 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.993246 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2ec03e9c1a71446b0ce55183cc9b990e4b43eb7aa126a0f07917415394c84f"} err="failed to get container status \"df2ec03e9c1a71446b0ce55183cc9b990e4b43eb7aa126a0f07917415394c84f\": rpc error: code = NotFound desc = could not find container \"df2ec03e9c1a71446b0ce55183cc9b990e4b43eb7aa126a0f07917415394c84f\": container with ID starting with df2ec03e9c1a71446b0ce55183cc9b990e4b43eb7aa126a0f07917415394c84f not found: ID does not exist" Jul 24 15:03:45.993305 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:45.993269 2581 scope.go:117] "RemoveContainer" containerID="acc0b2f274dfd0bfe3c3d52ffffd335f7ca6ff6cfc5d90cbb099159e9a19bd39" Jul 24 15:03:46.001684 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:46.001658 2581 scope.go:117] "RemoveContainer" containerID="acc0b2f274dfd0bfe3c3d52ffffd335f7ca6ff6cfc5d90cbb099159e9a19bd39" Jul 24 15:03:46.001937 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:03:46.001920 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acc0b2f274dfd0bfe3c3d52ffffd335f7ca6ff6cfc5d90cbb099159e9a19bd39\": container with ID starting with acc0b2f274dfd0bfe3c3d52ffffd335f7ca6ff6cfc5d90cbb099159e9a19bd39 not found: ID does not exist" containerID="acc0b2f274dfd0bfe3c3d52ffffd335f7ca6ff6cfc5d90cbb099159e9a19bd39" Jul 24 15:03:46.001977 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:46.001943 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acc0b2f274dfd0bfe3c3d52ffffd335f7ca6ff6cfc5d90cbb099159e9a19bd39"} err="failed to get container status \"acc0b2f274dfd0bfe3c3d52ffffd335f7ca6ff6cfc5d90cbb099159e9a19bd39\": rpc error: code = NotFound desc = could not find container \"acc0b2f274dfd0bfe3c3d52ffffd335f7ca6ff6cfc5d90cbb099159e9a19bd39\": container with ID starting with acc0b2f274dfd0bfe3c3d52ffffd335f7ca6ff6cfc5d90cbb099159e9a19bd39 not found: ID does not exist" Jul 24 15:03:46.009823 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:46.009800 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2"] Jul 24 15:03:46.017754 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:46.017732 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6726d865-97c5bccb-xjgx2"] Jul 24 15:03:46.029399 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:46.029376 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8"] Jul 24 15:03:46.035171 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:46.035145 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6726d865-5f5466558b-th2p8"] Jul 24 15:03:46.972967 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:46.972935 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4762ea53-6a84-4769-baf1-3b8b8066aea1" path="/var/lib/kubelet/pods/4762ea53-6a84-4769-baf1-3b8b8066aea1/volumes" Jul 24 15:03:46.973305 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:46.973292 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a" path="/var/lib/kubelet/pods/67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a/volumes" Jul 24 15:03:56.418046 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:56.418007 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s"] Jul 24 15:03:56.418686 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:56.418239 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" podUID="d656a005-41af-4924-b034-08b3e319b399" containerName="istio-proxy" containerID="cri-o://4ba8f395da75d1735c127599f8ef21ee4034bf28c578693dbc201e2dcdc727e9" gracePeriod=30 Jul 24 15:03:58.442639 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:58.442598 2581 patch_prober.go:28] interesting pod/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 24 15:03:58.443131 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:03:58.442682 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" podUID="d656a005-41af-4924-b034-08b3e319b399" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 15:04:01.682768 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.682705 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:04:01.741659 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.741628 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-workload-certs\") pod \"d656a005-41af-4924-b034-08b3e319b399\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " Jul 24 15:04:01.741830 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.741670 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d656a005-41af-4924-b034-08b3e319b399-istio-podinfo\") pod \"d656a005-41af-4924-b034-08b3e319b399\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " Jul 24 15:04:01.741830 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.741704 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-istio-data\") pod \"d656a005-41af-4924-b034-08b3e319b399\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " Jul 24 15:04:01.741830 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.741722 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-credential-socket\") pod \"d656a005-41af-4924-b034-08b3e319b399\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " Jul 24 15:04:01.741830 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.741764 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lghp\" (UniqueName: \"kubernetes.io/projected/d656a005-41af-4924-b034-08b3e319b399-kube-api-access-8lghp\") pod \"d656a005-41af-4924-b034-08b3e319b399\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " Jul 24 15:04:01.741830 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.741813 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-workload-socket\") pod \"d656a005-41af-4924-b034-08b3e319b399\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " Jul 24 15:04:01.742091 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.741840 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d656a005-41af-4924-b034-08b3e319b399" (UID: "d656a005-41af-4924-b034-08b3e319b399"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:04:01.742091 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.741860 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-istio-envoy\") pod \"d656a005-41af-4924-b034-08b3e319b399\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " Jul 24 15:04:01.742091 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.741885 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d656a005-41af-4924-b034-08b3e319b399-istiod-ca-cert\") pod \"d656a005-41af-4924-b034-08b3e319b399\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " Jul 24 15:04:01.742091 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.741921 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d656a005-41af-4924-b034-08b3e319b399-istio-token\") pod \"d656a005-41af-4924-b034-08b3e319b399\" (UID: \"d656a005-41af-4924-b034-08b3e319b399\") " Jul 24 15:04:01.742091 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.742063 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d656a005-41af-4924-b034-08b3e319b399" (UID: "d656a005-41af-4924-b034-08b3e319b399"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:04:01.742352 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.742113 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d656a005-41af-4924-b034-08b3e319b399" (UID: "d656a005-41af-4924-b034-08b3e319b399"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:04:01.742352 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.742274 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-workload-certs\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:04:01.742352 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.742292 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-credential-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:04:01.742352 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.742307 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-workload-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:04:01.742600 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.742561 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d656a005-41af-4924-b034-08b3e319b399-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d656a005-41af-4924-b034-08b3e319b399" (UID: "d656a005-41af-4924-b034-08b3e319b399"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:04:01.742758 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.742731 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-istio-data" (OuterVolumeSpecName: "istio-data") pod "d656a005-41af-4924-b034-08b3e319b399" (UID: "d656a005-41af-4924-b034-08b3e319b399"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:04:01.744058 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.744024 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d656a005-41af-4924-b034-08b3e319b399-istio-token" (OuterVolumeSpecName: "istio-token") pod "d656a005-41af-4924-b034-08b3e319b399" (UID: "d656a005-41af-4924-b034-08b3e319b399"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:04:01.744058 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.744047 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d656a005-41af-4924-b034-08b3e319b399-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d656a005-41af-4924-b034-08b3e319b399" (UID: "d656a005-41af-4924-b034-08b3e319b399"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 15:04:01.744262 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.744104 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d656a005-41af-4924-b034-08b3e319b399" (UID: "d656a005-41af-4924-b034-08b3e319b399"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:04:01.744325 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.744290 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d656a005-41af-4924-b034-08b3e319b399-kube-api-access-8lghp" (OuterVolumeSpecName: "kube-api-access-8lghp") pod "d656a005-41af-4924-b034-08b3e319b399" (UID: "d656a005-41af-4924-b034-08b3e319b399"). InnerVolumeSpecName "kube-api-access-8lghp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:04:01.843228 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.843194 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-istio-envoy\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:04:01.843228 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.843223 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d656a005-41af-4924-b034-08b3e319b399-istiod-ca-cert\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:04:01.843228 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.843233 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d656a005-41af-4924-b034-08b3e319b399-istio-token\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:04:01.843471 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.843243 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d656a005-41af-4924-b034-08b3e319b399-istio-podinfo\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:04:01.843471 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.843250 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d656a005-41af-4924-b034-08b3e319b399-istio-data\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:04:01.843471 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:01.843259 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lghp\" (UniqueName: \"kubernetes.io/projected/d656a005-41af-4924-b034-08b3e319b399-kube-api-access-8lghp\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:04:02.072074 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:02.072039 2581 generic.go:356] "Generic (PLEG): container finished" podID="d656a005-41af-4924-b034-08b3e319b399" containerID="4ba8f395da75d1735c127599f8ef21ee4034bf28c578693dbc201e2dcdc727e9" exitCode=0 Jul 24 15:04:02.072279 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:02.072087 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" Jul 24 15:04:02.072279 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:02.072128 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" event={"ID":"d656a005-41af-4924-b034-08b3e319b399","Type":"ContainerDied","Data":"4ba8f395da75d1735c127599f8ef21ee4034bf28c578693dbc201e2dcdc727e9"} Jul 24 15:04:02.072279 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:02.072187 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s" event={"ID":"d656a005-41af-4924-b034-08b3e319b399","Type":"ContainerDied","Data":"0cecacce5d26305e74d8c3b1cf64857cc001c96a241f4fab2a14e8f2ed589be0"} Jul 24 15:04:02.072279 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:02.072218 2581 scope.go:117] "RemoveContainer" containerID="4ba8f395da75d1735c127599f8ef21ee4034bf28c578693dbc201e2dcdc727e9" Jul 24 15:04:02.081436 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:02.081413 2581 scope.go:117] "RemoveContainer" containerID="2a2743d67905e49304fd812a52bf3822777fbd19fc552b2be3392a360dacb97c" Jul 24 15:04:02.090004 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:02.089984 2581 scope.go:117] "RemoveContainer" containerID="4ba8f395da75d1735c127599f8ef21ee4034bf28c578693dbc201e2dcdc727e9" Jul 24 15:04:02.090277 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:04:02.090257 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ba8f395da75d1735c127599f8ef21ee4034bf28c578693dbc201e2dcdc727e9\": container with ID starting with 4ba8f395da75d1735c127599f8ef21ee4034bf28c578693dbc201e2dcdc727e9 not found: ID does not exist" containerID="4ba8f395da75d1735c127599f8ef21ee4034bf28c578693dbc201e2dcdc727e9" Jul 24 15:04:02.090351 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:02.090290 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba8f395da75d1735c127599f8ef21ee4034bf28c578693dbc201e2dcdc727e9"} err="failed to get container status \"4ba8f395da75d1735c127599f8ef21ee4034bf28c578693dbc201e2dcdc727e9\": rpc error: code = NotFound desc = could not find container \"4ba8f395da75d1735c127599f8ef21ee4034bf28c578693dbc201e2dcdc727e9\": container with ID starting with 4ba8f395da75d1735c127599f8ef21ee4034bf28c578693dbc201e2dcdc727e9 not found: ID does not exist" Jul 24 15:04:02.090351 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:02.090319 2581 scope.go:117] "RemoveContainer" containerID="2a2743d67905e49304fd812a52bf3822777fbd19fc552b2be3392a360dacb97c" Jul 24 15:04:02.090609 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:04:02.090587 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a2743d67905e49304fd812a52bf3822777fbd19fc552b2be3392a360dacb97c\": container with ID starting with 2a2743d67905e49304fd812a52bf3822777fbd19fc552b2be3392a360dacb97c not found: ID does not exist" containerID="2a2743d67905e49304fd812a52bf3822777fbd19fc552b2be3392a360dacb97c" Jul 24 15:04:02.090656 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:02.090621 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2743d67905e49304fd812a52bf3822777fbd19fc552b2be3392a360dacb97c"} err="failed to get container status \"2a2743d67905e49304fd812a52bf3822777fbd19fc552b2be3392a360dacb97c\": rpc error: code = NotFound desc = could not find container \"2a2743d67905e49304fd812a52bf3822777fbd19fc552b2be3392a360dacb97c\": container with ID starting with 2a2743d67905e49304fd812a52bf3822777fbd19fc552b2be3392a360dacb97c not found: ID does not exist" Jul 24 15:04:02.093504 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:02.093482 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s"] Jul 24 15:04:02.097935 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:02.097914 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6726d865-openshift-default-565c599dbd-rst2s"] Jul 24 15:04:02.973769 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:02.973737 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d656a005-41af-4924-b034-08b3e319b399" path="/var/lib/kubelet/pods/d656a005-41af-4924-b034-08b3e319b399/volumes" Jul 24 15:04:17.086036 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.085994 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t"] Jul 24 15:04:17.086411 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.086395 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d656a005-41af-4924-b034-08b3e319b399" containerName="istio-proxy" Jul 24 15:04:17.086411 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.086406 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d656a005-41af-4924-b034-08b3e319b399" containerName="istio-proxy" Jul 24 15:04:17.086489 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.086413 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a" containerName="payload-processing" Jul 24 15:04:17.086489 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.086420 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a" containerName="payload-processing" Jul 24 15:04:17.086489 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.086444 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4762ea53-6a84-4769-baf1-3b8b8066aea1" containerName="payload-pre-processing" Jul 24 15:04:17.086489 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.086449 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4762ea53-6a84-4769-baf1-3b8b8066aea1" containerName="payload-pre-processing" Jul 24 15:04:17.086489 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.086457 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d656a005-41af-4924-b034-08b3e319b399" containerName="istio-proxy" Jul 24 15:04:17.086489 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.086462 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d656a005-41af-4924-b034-08b3e319b399" containerName="istio-proxy" Jul 24 15:04:17.086730 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.086543 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d656a005-41af-4924-b034-08b3e319b399" containerName="istio-proxy" Jul 24 15:04:17.086730 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.086554 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4762ea53-6a84-4769-baf1-3b8b8066aea1" containerName="payload-pre-processing" Jul 24 15:04:17.086730 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.086563 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d656a005-41af-4924-b034-08b3e319b399" containerName="istio-proxy" Jul 24 15:04:17.086730 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.086572 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="67160bb3-ec13-4ac0-8ad6-b8d1eb99cb1a" containerName="payload-processing" Jul 24 15:04:17.089735 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.089714 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.093471 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.093435 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-040dfbba-openshift-default-dockercfg-5v2t9\"" Jul 24 15:04:17.107245 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.107214 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t"] Jul 24 15:04:17.193376 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.193339 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq262\" (UniqueName: \"kubernetes.io/projected/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-kube-api-access-wq262\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.193615 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.193398 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-envoy\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.193615 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.193428 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-workload-socket\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.193615 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.193548 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-credential-socket\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.193799 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.193633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-workload-certs\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.193799 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.193755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-data\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.193799 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.193793 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-token\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.193959 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.193851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-podinfo\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.193959 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.193908 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istiod-ca-cert\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.294742 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.294703 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-workload-certs\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.294960 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.294790 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-data\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.294960 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.294814 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-token\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.294960 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.294833 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-podinfo\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.294960 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.294859 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istiod-ca-cert\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.294960 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.294878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq262\" (UniqueName: \"kubernetes.io/projected/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-kube-api-access-wq262\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.294960 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.294933 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-envoy\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.295275 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.294970 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-workload-socket\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.295275 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.295024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-credential-socket\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.295275 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.295173 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-workload-certs\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.295436 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.295370 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-credential-socket\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.295970 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.295878 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-data\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.296128 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.295459 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-workload-socket\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.297035 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.296350 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istiod-ca-cert\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.298114 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.297958 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-podinfo\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.304982 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.304948 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq262\" (UniqueName: \"kubernetes.io/projected/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-kube-api-access-wq262\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.306492 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.306467 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-envoy\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.307163 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.307145 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-token\") pod \"e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.400920 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.400818 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:17.553495 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.553459 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t"] Jul 24 15:04:17.554984 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:04:17.554959 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d35ec8_ecf2_4c13_b4c5_67a9e62758fc.slice/crio-f5bc25e6c07f5f9dac0f0e13bc5a0d980b4295385abfb7bb16230f664f696f12 WatchSource:0}: Error finding container f5bc25e6c07f5f9dac0f0e13bc5a0d980b4295385abfb7bb16230f664f696f12: Status 404 returned error can't find the container with id f5bc25e6c07f5f9dac0f0e13bc5a0d980b4295385abfb7bb16230f664f696f12 Jul 24 15:04:17.557147 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.557110 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:04:17.557251 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.557184 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:04:17.557251 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:17.557218 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:04:18.156833 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:18.156792 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" event={"ID":"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc","Type":"ContainerStarted","Data":"8d4269846a473836885b656bdda595a2795e0b0c96fea548ca63d8bf600ffbe3"} Jul 24 15:04:18.157332 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:18.156855 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" event={"ID":"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc","Type":"ContainerStarted","Data":"f5bc25e6c07f5f9dac0f0e13bc5a0d980b4295385abfb7bb16230f664f696f12"} Jul 24 15:04:18.176610 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:18.176552 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" podStartSLOduration=1.176511001 podStartE2EDuration="1.176511001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:04:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:04:18.176366809 +0000 UTC m=+1953.733282716" watchObservedRunningTime="2026-07-24 15:04:18.176511001 +0000 UTC m=+1953.733426892" Jul 24 15:04:18.401626 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:18.401578 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:18.406724 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:18.406698 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:19.162218 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:19.162186 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:19.163347 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:19.163322 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:21.398859 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.398825 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2"] Jul 24 15:04:21.402478 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.402459 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" Jul 24 15:04:21.405659 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.405639 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-040dfbba-dockercfg-x5c5s\"" Jul 24 15:04:21.406686 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.406667 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-040dfbba\"" Jul 24 15:04:21.414049 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.414027 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2"] Jul 24 15:04:21.490646 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.490614 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj"] Jul 24 15:04:21.493915 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.493899 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" Jul 24 15:04:21.511362 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.511314 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj"] Jul 24 15:04:21.534125 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.534096 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f3b65d1-fdca-4b88-bec3-705f09af424e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2\" (UID: \"2f3b65d1-fdca-4b88-bec3-705f09af424e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" Jul 24 15:04:21.534285 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.534170 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrwqj\" (UniqueName: \"kubernetes.io/projected/2f3b65d1-fdca-4b88-bec3-705f09af424e-kube-api-access-qrwqj\") pod \"payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2\" (UID: \"2f3b65d1-fdca-4b88-bec3-705f09af424e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" Jul 24 15:04:21.635469 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.635429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f3b65d1-fdca-4b88-bec3-705f09af424e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2\" (UID: \"2f3b65d1-fdca-4b88-bec3-705f09af424e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" Jul 24 15:04:21.635690 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.635477 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/076082f5-290f-4174-a1dd-454eb47af260-plugins-config-volume\") pod \"payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj\" (UID: \"076082f5-290f-4174-a1dd-454eb47af260\") " pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" Jul 24 15:04:21.635690 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.635642 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrwqj\" (UniqueName: \"kubernetes.io/projected/2f3b65d1-fdca-4b88-bec3-705f09af424e-kube-api-access-qrwqj\") pod \"payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2\" (UID: \"2f3b65d1-fdca-4b88-bec3-705f09af424e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" Jul 24 15:04:21.635772 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.635706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9lrb\" (UniqueName: \"kubernetes.io/projected/076082f5-290f-4174-a1dd-454eb47af260-kube-api-access-d9lrb\") pod \"payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj\" (UID: \"076082f5-290f-4174-a1dd-454eb47af260\") " pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" Jul 24 15:04:21.636152 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.636134 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f3b65d1-fdca-4b88-bec3-705f09af424e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2\" (UID: \"2f3b65d1-fdca-4b88-bec3-705f09af424e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" Jul 24 15:04:21.644444 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.644419 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrwqj\" (UniqueName: \"kubernetes.io/projected/2f3b65d1-fdca-4b88-bec3-705f09af424e-kube-api-access-qrwqj\") pod \"payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2\" (UID: \"2f3b65d1-fdca-4b88-bec3-705f09af424e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" Jul 24 15:04:21.714550 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.714445 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" Jul 24 15:04:21.736239 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.736202 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/076082f5-290f-4174-a1dd-454eb47af260-plugins-config-volume\") pod \"payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj\" (UID: \"076082f5-290f-4174-a1dd-454eb47af260\") " pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" Jul 24 15:04:21.736392 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.736355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9lrb\" (UniqueName: \"kubernetes.io/projected/076082f5-290f-4174-a1dd-454eb47af260-kube-api-access-d9lrb\") pod \"payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj\" (UID: \"076082f5-290f-4174-a1dd-454eb47af260\") " pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" Jul 24 15:04:21.737069 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.737039 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/076082f5-290f-4174-a1dd-454eb47af260-plugins-config-volume\") pod \"payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj\" (UID: \"076082f5-290f-4174-a1dd-454eb47af260\") " pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" Jul 24 15:04:21.745603 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.745576 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9lrb\" (UniqueName: \"kubernetes.io/projected/076082f5-290f-4174-a1dd-454eb47af260-kube-api-access-d9lrb\") pod \"payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj\" (UID: \"076082f5-290f-4174-a1dd-454eb47af260\") " pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" Jul 24 15:04:21.806739 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.806701 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" Jul 24 15:04:21.871833 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:04:21.871778 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3b65d1_fdca_4b88_bec3_705f09af424e.slice/crio-45c6a3d1c8307d3a83b858f460104fea87971ff3b233b2cf53c3af440c2eb0cb WatchSource:0}: Error finding container 45c6a3d1c8307d3a83b858f460104fea87971ff3b233b2cf53c3af440c2eb0cb: Status 404 returned error can't find the container with id 45c6a3d1c8307d3a83b858f460104fea87971ff3b233b2cf53c3af440c2eb0cb Jul 24 15:04:21.873073 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.872971 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2"] Jul 24 15:04:21.961343 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:21.961319 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj"] Jul 24 15:04:21.962900 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:04:21.962871 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod076082f5_290f_4174_a1dd_454eb47af260.slice/crio-1f6f151172864232c083d8ea123b4b1ab9a60b28fd9950d9b861b1b7c2f4a6da WatchSource:0}: Error finding container 1f6f151172864232c083d8ea123b4b1ab9a60b28fd9950d9b861b1b7c2f4a6da: Status 404 returned error can't find the container with id 1f6f151172864232c083d8ea123b4b1ab9a60b28fd9950d9b861b1b7c2f4a6da Jul 24 15:04:22.178676 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:22.178634 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" event={"ID":"076082f5-290f-4174-a1dd-454eb47af260","Type":"ContainerStarted","Data":"20f17c226555cd923daa887115a240d2f82984ab56a26bab1a08d5d4b1336baf"} Jul 24 15:04:22.178885 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:22.178811 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" Jul 24 15:04:22.178885 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:22.178850 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" event={"ID":"076082f5-290f-4174-a1dd-454eb47af260","Type":"ContainerStarted","Data":"1f6f151172864232c083d8ea123b4b1ab9a60b28fd9950d9b861b1b7c2f4a6da"} Jul 24 15:04:22.180324 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:22.180300 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" event={"ID":"2f3b65d1-fdca-4b88-bec3-705f09af424e","Type":"ContainerStarted","Data":"b100c79900bb64b5619aac91ab7f63ce2f84b162f7366681d9800c8f0dc43c87"} Jul 24 15:04:22.180454 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:22.180336 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" event={"ID":"2f3b65d1-fdca-4b88-bec3-705f09af424e","Type":"ContainerStarted","Data":"45c6a3d1c8307d3a83b858f460104fea87971ff3b233b2cf53c3af440c2eb0cb"} Jul 24 15:04:22.180454 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:22.180408 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" Jul 24 15:04:22.199380 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:22.199330 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" podStartSLOduration=1.199314812 podStartE2EDuration="1.199314812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:04:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:04:22.196866023 +0000 UTC m=+1957.753781916" watchObservedRunningTime="2026-07-24 15:04:22.199314812 +0000 UTC m=+1957.756230703" Jul 24 15:04:22.230966 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:22.230861 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" podStartSLOduration=1.23084504 podStartE2EDuration="1.23084504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:04:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:04:22.229873928 +0000 UTC m=+1957.786789821" watchObservedRunningTime="2026-07-24 15:04:22.23084504 +0000 UTC m=+1957.787760931" Jul 24 15:04:33.188942 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:33.188890 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" podUID="2f3b65d1-fdca-4b88-bec3-705f09af424e" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.63:9004: connect: connection refused" Jul 24 15:04:33.189451 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:33.189430 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" Jul 24 15:04:34.163386 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:34.163351 2581 patch_prober.go:28] interesting pod/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 24 15:04:34.163639 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:34.163407 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" podUID="81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 24 15:04:34.252858 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:34.252819 2581 generic.go:356] "Generic (PLEG): container finished" podID="81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" containerID="8d4269846a473836885b656bdda595a2795e0b0c96fea548ca63d8bf600ffbe3" exitCode=0 Jul 24 15:04:34.253282 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:34.252891 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" event={"ID":"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc","Type":"ContainerDied","Data":"8d4269846a473836885b656bdda595a2795e0b0c96fea548ca63d8bf600ffbe3"} Jul 24 15:04:34.253344 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:34.253330 2581 scope.go:117] "RemoveContainer" containerID="8d4269846a473836885b656bdda595a2795e0b0c96fea548ca63d8bf600ffbe3" Jul 24 15:04:34.254387 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:34.254358 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:04:34.254443 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:34.254426 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:04:34.254491 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:34.254463 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:04:35.266573 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:35.266507 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" event={"ID":"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc","Type":"ContainerStarted","Data":"843a3d3f275f4d8b9ce4b6573cd8d07e37eec3e29baa37c1e62edf890f5d3b23"} Jul 24 15:04:35.401407 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:35.401378 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:35.401617 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:35.401595 2581 patch_prober.go:28] interesting pod/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 24 15:04:35.401675 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:35.401656 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" podUID="81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 24 15:04:36.401996 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:36.401962 2581 patch_prober.go:28] interesting pod/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 24 15:04:36.402433 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:36.402019 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" podUID="81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 24 15:04:37.402125 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:37.402041 2581 patch_prober.go:28] interesting pod/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 24 15:04:37.402125 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:37.402096 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" podUID="81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 24 15:04:38.402021 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:38.401975 2581 patch_prober.go:28] interesting pod/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Jul 24 15:04:38.402214 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:38.402039 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" podUID="81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Jul 24 15:04:39.404764 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:39.404730 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:39.405194 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:39.405060 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:39.405622 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:39.405604 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:04:43.188350 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:04:43.188322 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" Jul 24 15:05:25.162030 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.161990 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj"] Jul 24 15:05:25.162754 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.162251 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" podUID="076082f5-290f-4174-a1dd-454eb47af260" containerName="payload-processing" containerID="cri-o://20f17c226555cd923daa887115a240d2f82984ab56a26bab1a08d5d4b1336baf" gracePeriod=30 Jul 24 15:05:25.172213 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.172187 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2"] Jul 24 15:05:25.172408 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.172387 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" podUID="2f3b65d1-fdca-4b88-bec3-705f09af424e" containerName="payload-pre-processing" containerID="cri-o://b100c79900bb64b5619aac91ab7f63ce2f84b162f7366681d9800c8f0dc43c87" gracePeriod=30 Jul 24 15:05:25.435795 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.435770 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" Jul 24 15:05:25.462155 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.462128 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" Jul 24 15:05:25.532076 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.532039 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/076082f5-290f-4174-a1dd-454eb47af260-plugins-config-volume\") pod \"076082f5-290f-4174-a1dd-454eb47af260\" (UID: \"076082f5-290f-4174-a1dd-454eb47af260\") " Jul 24 15:05:25.532260 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.532117 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9lrb\" (UniqueName: \"kubernetes.io/projected/076082f5-290f-4174-a1dd-454eb47af260-kube-api-access-d9lrb\") pod \"076082f5-290f-4174-a1dd-454eb47af260\" (UID: \"076082f5-290f-4174-a1dd-454eb47af260\") " Jul 24 15:05:25.532488 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.532466 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/076082f5-290f-4174-a1dd-454eb47af260-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "076082f5-290f-4174-a1dd-454eb47af260" (UID: "076082f5-290f-4174-a1dd-454eb47af260"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:05:25.534191 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.534165 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/076082f5-290f-4174-a1dd-454eb47af260-kube-api-access-d9lrb" (OuterVolumeSpecName: "kube-api-access-d9lrb") pod "076082f5-290f-4174-a1dd-454eb47af260" (UID: "076082f5-290f-4174-a1dd-454eb47af260"). InnerVolumeSpecName "kube-api-access-d9lrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:05:25.541821 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.541793 2581 generic.go:356] "Generic (PLEG): container finished" podID="076082f5-290f-4174-a1dd-454eb47af260" containerID="20f17c226555cd923daa887115a240d2f82984ab56a26bab1a08d5d4b1336baf" exitCode=0 Jul 24 15:05:25.541967 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.541841 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" Jul 24 15:05:25.541967 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.541870 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" event={"ID":"076082f5-290f-4174-a1dd-454eb47af260","Type":"ContainerDied","Data":"20f17c226555cd923daa887115a240d2f82984ab56a26bab1a08d5d4b1336baf"} Jul 24 15:05:25.541967 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.541919 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj" event={"ID":"076082f5-290f-4174-a1dd-454eb47af260","Type":"ContainerDied","Data":"1f6f151172864232c083d8ea123b4b1ab9a60b28fd9950d9b861b1b7c2f4a6da"} Jul 24 15:05:25.541967 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.541941 2581 scope.go:117] "RemoveContainer" containerID="20f17c226555cd923daa887115a240d2f82984ab56a26bab1a08d5d4b1336baf" Jul 24 15:05:25.543234 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.543211 2581 generic.go:356] "Generic (PLEG): container finished" podID="2f3b65d1-fdca-4b88-bec3-705f09af424e" containerID="b100c79900bb64b5619aac91ab7f63ce2f84b162f7366681d9800c8f0dc43c87" exitCode=0 Jul 24 15:05:25.543387 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.543238 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" event={"ID":"2f3b65d1-fdca-4b88-bec3-705f09af424e","Type":"ContainerDied","Data":"b100c79900bb64b5619aac91ab7f63ce2f84b162f7366681d9800c8f0dc43c87"} Jul 24 15:05:25.543387 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.543262 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" Jul 24 15:05:25.543387 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.543286 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2" event={"ID":"2f3b65d1-fdca-4b88-bec3-705f09af424e","Type":"ContainerDied","Data":"45c6a3d1c8307d3a83b858f460104fea87971ff3b233b2cf53c3af440c2eb0cb"} Jul 24 15:05:25.551957 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.551933 2581 scope.go:117] "RemoveContainer" containerID="20f17c226555cd923daa887115a240d2f82984ab56a26bab1a08d5d4b1336baf" Jul 24 15:05:25.552296 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:05:25.552272 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20f17c226555cd923daa887115a240d2f82984ab56a26bab1a08d5d4b1336baf\": container with ID starting with 20f17c226555cd923daa887115a240d2f82984ab56a26bab1a08d5d4b1336baf not found: ID does not exist" containerID="20f17c226555cd923daa887115a240d2f82984ab56a26bab1a08d5d4b1336baf" Jul 24 15:05:25.552397 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.552301 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20f17c226555cd923daa887115a240d2f82984ab56a26bab1a08d5d4b1336baf"} err="failed to get container status \"20f17c226555cd923daa887115a240d2f82984ab56a26bab1a08d5d4b1336baf\": rpc error: code = NotFound desc = could not find container \"20f17c226555cd923daa887115a240d2f82984ab56a26bab1a08d5d4b1336baf\": container with ID starting with 20f17c226555cd923daa887115a240d2f82984ab56a26bab1a08d5d4b1336baf not found: ID does not exist" Jul 24 15:05:25.552397 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.552323 2581 scope.go:117] "RemoveContainer" containerID="b100c79900bb64b5619aac91ab7f63ce2f84b162f7366681d9800c8f0dc43c87" Jul 24 15:05:25.560613 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.560596 2581 scope.go:117] "RemoveContainer" containerID="b100c79900bb64b5619aac91ab7f63ce2f84b162f7366681d9800c8f0dc43c87" Jul 24 15:05:25.560839 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:05:25.560820 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b100c79900bb64b5619aac91ab7f63ce2f84b162f7366681d9800c8f0dc43c87\": container with ID starting with b100c79900bb64b5619aac91ab7f63ce2f84b162f7366681d9800c8f0dc43c87 not found: ID does not exist" containerID="b100c79900bb64b5619aac91ab7f63ce2f84b162f7366681d9800c8f0dc43c87" Jul 24 15:05:25.560889 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.560846 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b100c79900bb64b5619aac91ab7f63ce2f84b162f7366681d9800c8f0dc43c87"} err="failed to get container status \"b100c79900bb64b5619aac91ab7f63ce2f84b162f7366681d9800c8f0dc43c87\": rpc error: code = NotFound desc = could not find container \"b100c79900bb64b5619aac91ab7f63ce2f84b162f7366681d9800c8f0dc43c87\": container with ID starting with b100c79900bb64b5619aac91ab7f63ce2f84b162f7366681d9800c8f0dc43c87 not found: ID does not exist" Jul 24 15:05:25.566805 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.566783 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj"] Jul 24 15:05:25.570756 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.570726 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-040dfbba-8449bd7798-dzgnj"] Jul 24 15:05:25.633677 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.633643 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrwqj\" (UniqueName: \"kubernetes.io/projected/2f3b65d1-fdca-4b88-bec3-705f09af424e-kube-api-access-qrwqj\") pod \"2f3b65d1-fdca-4b88-bec3-705f09af424e\" (UID: \"2f3b65d1-fdca-4b88-bec3-705f09af424e\") " Jul 24 15:05:25.633851 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.633694 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f3b65d1-fdca-4b88-bec3-705f09af424e-plugins-config-volume\") pod \"2f3b65d1-fdca-4b88-bec3-705f09af424e\" (UID: \"2f3b65d1-fdca-4b88-bec3-705f09af424e\") " Jul 24 15:05:25.633975 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.633955 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/076082f5-290f-4174-a1dd-454eb47af260-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:05:25.634013 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.633982 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9lrb\" (UniqueName: \"kubernetes.io/projected/076082f5-290f-4174-a1dd-454eb47af260-kube-api-access-d9lrb\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:05:25.634150 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.634126 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f3b65d1-fdca-4b88-bec3-705f09af424e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2f3b65d1-fdca-4b88-bec3-705f09af424e" (UID: "2f3b65d1-fdca-4b88-bec3-705f09af424e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:05:25.635844 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.635821 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f3b65d1-fdca-4b88-bec3-705f09af424e-kube-api-access-qrwqj" (OuterVolumeSpecName: "kube-api-access-qrwqj") pod "2f3b65d1-fdca-4b88-bec3-705f09af424e" (UID: "2f3b65d1-fdca-4b88-bec3-705f09af424e"). InnerVolumeSpecName "kube-api-access-qrwqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:05:25.734524 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.734428 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrwqj\" (UniqueName: \"kubernetes.io/projected/2f3b65d1-fdca-4b88-bec3-705f09af424e-kube-api-access-qrwqj\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:05:25.734524 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.734462 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f3b65d1-fdca-4b88-bec3-705f09af424e-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:05:25.871602 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.871568 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2"] Jul 24 15:05:25.874963 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:25.874935 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-040dfbba-77b58bdb8d-fnhr2"] Jul 24 15:05:26.972282 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:26.972239 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="076082f5-290f-4174-a1dd-454eb47af260" path="/var/lib/kubelet/pods/076082f5-290f-4174-a1dd-454eb47af260/volumes" Jul 24 15:05:26.972821 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:05:26.972767 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f3b65d1-fdca-4b88-bec3-705f09af424e" path="/var/lib/kubelet/pods/2f3b65d1-fdca-4b88-bec3-705f09af424e/volumes" Jul 24 15:06:21.775220 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:21.775138 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t"] Jul 24 15:06:21.775792 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:21.775421 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" podUID="81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" containerName="istio-proxy" containerID="cri-o://843a3d3f275f4d8b9ce4b6573cd8d07e37eec3e29baa37c1e62edf890f5d3b23" gracePeriod=30 Jul 24 15:06:24.407297 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:24.407258 2581 patch_prober.go:28] interesting pod/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 15:06:24.407724 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:24.407320 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" podUID="81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 15:06:27.069731 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.069705 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:06:27.093316 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.093277 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-data\") pod \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " Jul 24 15:06:27.093508 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.093331 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-token\") pod \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " Jul 24 15:06:27.093508 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.093362 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-workload-socket\") pod \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " Jul 24 15:06:27.093508 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.093381 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-workload-certs\") pod \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " Jul 24 15:06:27.093508 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.093407 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wq262\" (UniqueName: \"kubernetes.io/projected/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-kube-api-access-wq262\") pod \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " Jul 24 15:06:27.093508 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.093440 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-credential-socket\") pod \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " Jul 24 15:06:27.093800 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.093693 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" (UID: "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:06:27.093800 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.093766 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istiod-ca-cert\") pod \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " Jul 24 15:06:27.093800 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.093768 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" (UID: "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:06:27.093800 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.093783 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" (UID: "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:06:27.094006 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.093804 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-envoy\") pod \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " Jul 24 15:06:27.094006 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.093901 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-podinfo\") pod \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\" (UID: \"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc\") " Jul 24 15:06:27.094112 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.094048 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" (UID: "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:06:27.094112 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.094086 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-data" (OuterVolumeSpecName: "istio-data") pod "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" (UID: "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:06:27.094298 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.094276 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-data\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:06:27.094373 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.094305 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-workload-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:06:27.094373 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.094321 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-workload-certs\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:06:27.094373 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.094335 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-credential-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:06:27.094373 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.094347 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istiod-ca-cert\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:06:27.096020 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.095991 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-token" (OuterVolumeSpecName: "istio-token") pod "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" (UID: "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:06:27.096020 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.096006 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" (UID: "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:06:27.096204 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.096024 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-kube-api-access-wq262" (OuterVolumeSpecName: "kube-api-access-wq262") pod "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" (UID: "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc"). InnerVolumeSpecName "kube-api-access-wq262". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:06:27.096894 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.096729 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" (UID: "81d35ec8-ecf2-4c13-b4c5-67a9e62758fc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 15:06:27.195803 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.195762 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-token\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:06:27.195803 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.195798 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wq262\" (UniqueName: \"kubernetes.io/projected/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-kube-api-access-wq262\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:06:27.195803 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.195811 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-envoy\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:06:27.196118 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.195825 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc-istio-podinfo\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:06:27.870812 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.870774 2581 generic.go:356] "Generic (PLEG): container finished" podID="81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" containerID="843a3d3f275f4d8b9ce4b6573cd8d07e37eec3e29baa37c1e62edf890f5d3b23" exitCode=0 Jul 24 15:06:27.871003 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.870832 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" Jul 24 15:06:27.871003 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.870846 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" event={"ID":"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc","Type":"ContainerDied","Data":"843a3d3f275f4d8b9ce4b6573cd8d07e37eec3e29baa37c1e62edf890f5d3b23"} Jul 24 15:06:27.871003 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.870901 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t" event={"ID":"81d35ec8-ecf2-4c13-b4c5-67a9e62758fc","Type":"ContainerDied","Data":"f5bc25e6c07f5f9dac0f0e13bc5a0d980b4295385abfb7bb16230f664f696f12"} Jul 24 15:06:27.871003 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.870933 2581 scope.go:117] "RemoveContainer" containerID="843a3d3f275f4d8b9ce4b6573cd8d07e37eec3e29baa37c1e62edf890f5d3b23" Jul 24 15:06:27.880885 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.880866 2581 scope.go:117] "RemoveContainer" containerID="8d4269846a473836885b656bdda595a2795e0b0c96fea548ca63d8bf600ffbe3" Jul 24 15:06:27.889360 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.889221 2581 scope.go:117] "RemoveContainer" containerID="843a3d3f275f4d8b9ce4b6573cd8d07e37eec3e29baa37c1e62edf890f5d3b23" Jul 24 15:06:27.889510 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:06:27.889488 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"843a3d3f275f4d8b9ce4b6573cd8d07e37eec3e29baa37c1e62edf890f5d3b23\": container with ID starting with 843a3d3f275f4d8b9ce4b6573cd8d07e37eec3e29baa37c1e62edf890f5d3b23 not found: ID does not exist" containerID="843a3d3f275f4d8b9ce4b6573cd8d07e37eec3e29baa37c1e62edf890f5d3b23" Jul 24 15:06:27.889577 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.889519 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"843a3d3f275f4d8b9ce4b6573cd8d07e37eec3e29baa37c1e62edf890f5d3b23"} err="failed to get container status \"843a3d3f275f4d8b9ce4b6573cd8d07e37eec3e29baa37c1e62edf890f5d3b23\": rpc error: code = NotFound desc = could not find container \"843a3d3f275f4d8b9ce4b6573cd8d07e37eec3e29baa37c1e62edf890f5d3b23\": container with ID starting with 843a3d3f275f4d8b9ce4b6573cd8d07e37eec3e29baa37c1e62edf890f5d3b23 not found: ID does not exist" Jul 24 15:06:27.889577 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.889555 2581 scope.go:117] "RemoveContainer" containerID="8d4269846a473836885b656bdda595a2795e0b0c96fea548ca63d8bf600ffbe3" Jul 24 15:06:27.889802 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:06:27.889783 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d4269846a473836885b656bdda595a2795e0b0c96fea548ca63d8bf600ffbe3\": container with ID starting with 8d4269846a473836885b656bdda595a2795e0b0c96fea548ca63d8bf600ffbe3 not found: ID does not exist" containerID="8d4269846a473836885b656bdda595a2795e0b0c96fea548ca63d8bf600ffbe3" Jul 24 15:06:27.889843 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.889809 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d4269846a473836885b656bdda595a2795e0b0c96fea548ca63d8bf600ffbe3"} err="failed to get container status \"8d4269846a473836885b656bdda595a2795e0b0c96fea548ca63d8bf600ffbe3\": rpc error: code = NotFound desc = could not find container \"8d4269846a473836885b656bdda595a2795e0b0c96fea548ca63d8bf600ffbe3\": container with ID starting with 8d4269846a473836885b656bdda595a2795e0b0c96fea548ca63d8bf600ffbe3 not found: ID does not exist" Jul 24 15:06:27.895256 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.895235 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t"] Jul 24 15:06:27.904401 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:27.904376 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-040dfbba-openshift-default-6cb9645c84-fx47t"] Jul 24 15:06:28.973552 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:28.973493 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" path="/var/lib/kubelet/pods/81d35ec8-ecf2-4c13-b4c5-67a9e62758fc/volumes" Jul 24 15:06:45.065871 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:45.065840 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 15:06:45.069438 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:45.069414 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 15:06:45.073324 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:45.073306 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 15:06:45.080540 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:06:45.080511 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 15:07:18.687017 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.686980 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v"] Jul 24 15:07:18.687666 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.687647 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3b65d1-fdca-4b88-bec3-705f09af424e" containerName="payload-pre-processing" Jul 24 15:07:18.687722 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.687669 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3b65d1-fdca-4b88-bec3-705f09af424e" containerName="payload-pre-processing" Jul 24 15:07:18.687722 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.687679 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" containerName="istio-proxy" Jul 24 15:07:18.687722 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.687685 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" containerName="istio-proxy" Jul 24 15:07:18.687722 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.687698 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" containerName="istio-proxy" Jul 24 15:07:18.687722 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.687704 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" containerName="istio-proxy" Jul 24 15:07:18.687722 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.687710 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="076082f5-290f-4174-a1dd-454eb47af260" containerName="payload-processing" Jul 24 15:07:18.687722 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.687716 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="076082f5-290f-4174-a1dd-454eb47af260" containerName="payload-processing" Jul 24 15:07:18.688029 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.687779 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f3b65d1-fdca-4b88-bec3-705f09af424e" containerName="payload-pre-processing" Jul 24 15:07:18.688029 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.687787 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="076082f5-290f-4174-a1dd-454eb47af260" containerName="payload-processing" Jul 24 15:07:18.688029 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.687798 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" containerName="istio-proxy" Jul 24 15:07:18.688029 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.687808 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="81d35ec8-ecf2-4c13-b4c5-67a9e62758fc" containerName="istio-proxy" Jul 24 15:07:18.690662 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.690643 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.695706 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.695685 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-39743c-openshift-default-dockercfg-6n5fr\"" Jul 24 15:07:18.731208 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.731166 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v"] Jul 24 15:07:18.795723 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.795688 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-data\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.795920 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.795735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-token\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.795920 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.795820 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-workload-socket\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.795920 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.795856 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-workload-certs\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.796047 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.795926 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istiod-ca-cert\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.796047 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.795974 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-podinfo\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.796047 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.796007 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-credential-socket\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.796047 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.796034 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8npv\" (UniqueName: \"kubernetes.io/projected/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-kube-api-access-r8npv\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.796195 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.796075 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-envoy\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.897061 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.897016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-workload-socket\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.897242 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.897077 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-workload-certs\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.897242 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.897121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istiod-ca-cert\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.897343 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.897244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-podinfo\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.897343 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.897318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-credential-socket\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.897432 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.897350 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8npv\" (UniqueName: \"kubernetes.io/projected/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-kube-api-access-r8npv\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.897432 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.897381 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-envoy\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.897432 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.897424 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-data\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.897571 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.897458 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-token\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.897571 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.897476 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-workload-socket\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.897571 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.897562 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-workload-certs\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.897816 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.897791 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-data\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.897937 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.897910 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istiod-ca-cert\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.898084 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.898061 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-credential-socket\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.899661 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.899641 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-envoy\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.899795 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.899778 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-podinfo\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.907483 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.907456 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8npv\" (UniqueName: \"kubernetes.io/projected/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-kube-api-access-r8npv\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:18.911625 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:18.911597 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-token\") pod \"e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:19.001300 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:19.001212 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:19.160214 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:19.159998 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v"] Jul 24 15:07:19.162603 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:07:19.162579 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ad21ea_5729_4ef7_bcf1_b49cc68aba79.slice/crio-ac7b76719c6d98c1bd022cf626c7060a31afed6597f10e22393ef4991981f456 WatchSource:0}: Error finding container ac7b76719c6d98c1bd022cf626c7060a31afed6597f10e22393ef4991981f456: Status 404 returned error can't find the container with id ac7b76719c6d98c1bd022cf626c7060a31afed6597f10e22393ef4991981f456 Jul 24 15:07:19.164629 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:19.164598 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:07:19.164721 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:19.164661 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:07:19.164721 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:19.164708 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:07:20.155804 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:20.155763 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" event={"ID":"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79","Type":"ContainerStarted","Data":"fc1f5216a6b20d4868f3b093ff029dd4e898bd8ffc998c8293a4436420b3546a"} Jul 24 15:07:20.156245 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:20.155822 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" event={"ID":"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79","Type":"ContainerStarted","Data":"ac7b76719c6d98c1bd022cf626c7060a31afed6597f10e22393ef4991981f456"} Jul 24 15:07:20.191822 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:20.191771 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" podStartSLOduration=2.191755061 podStartE2EDuration="2.191755061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:07:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:07:20.190351137 +0000 UTC m=+2135.747267029" watchObservedRunningTime="2026-07-24 15:07:20.191755061 +0000 UTC m=+2135.748671010" Jul 24 15:07:21.002146 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:21.002112 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:21.007033 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:21.007009 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:21.160667 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:21.160632 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:21.161695 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:21.161678 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:23.257720 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.257685 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j"] Jul 24 15:07:23.261146 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.261124 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" Jul 24 15:07:23.263723 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.263704 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-39743c-dockercfg-kvwrz\"" Jul 24 15:07:23.263820 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.263704 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-39743c\"" Jul 24 15:07:23.272234 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.272201 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j"] Jul 24 15:07:23.289974 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.289944 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb"] Jul 24 15:07:23.294044 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.294025 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" Jul 24 15:07:23.302773 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.302744 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb"] Jul 24 15:07:23.335372 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.335331 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxhdm\" (UniqueName: \"kubernetes.io/projected/c55462b1-bad9-4796-a11c-b929ed24975e-kube-api-access-jxhdm\") pod \"payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j\" (UID: \"c55462b1-bad9-4796-a11c-b929ed24975e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" Jul 24 15:07:23.335576 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.335423 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c55462b1-bad9-4796-a11c-b929ed24975e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j\" (UID: \"c55462b1-bad9-4796-a11c-b929ed24975e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" Jul 24 15:07:23.436881 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.436842 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chx9z\" (UniqueName: \"kubernetes.io/projected/5c6e095e-a029-4d55-999b-a4d9307835c8-kube-api-access-chx9z\") pod \"payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb\" (UID: \"5c6e095e-a029-4d55-999b-a4d9307835c8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" Jul 24 15:07:23.437060 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.436913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxhdm\" (UniqueName: \"kubernetes.io/projected/c55462b1-bad9-4796-a11c-b929ed24975e-kube-api-access-jxhdm\") pod \"payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j\" (UID: \"c55462b1-bad9-4796-a11c-b929ed24975e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" Jul 24 15:07:23.437060 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.436943 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c6e095e-a029-4d55-999b-a4d9307835c8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb\" (UID: \"5c6e095e-a029-4d55-999b-a4d9307835c8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" Jul 24 15:07:23.437060 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.436985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c55462b1-bad9-4796-a11c-b929ed24975e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j\" (UID: \"c55462b1-bad9-4796-a11c-b929ed24975e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" Jul 24 15:07:23.437672 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.437653 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c55462b1-bad9-4796-a11c-b929ed24975e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j\" (UID: \"c55462b1-bad9-4796-a11c-b929ed24975e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" Jul 24 15:07:23.445935 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.445906 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxhdm\" (UniqueName: \"kubernetes.io/projected/c55462b1-bad9-4796-a11c-b929ed24975e-kube-api-access-jxhdm\") pod \"payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j\" (UID: \"c55462b1-bad9-4796-a11c-b929ed24975e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" Jul 24 15:07:23.538247 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.538211 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chx9z\" (UniqueName: \"kubernetes.io/projected/5c6e095e-a029-4d55-999b-a4d9307835c8-kube-api-access-chx9z\") pod \"payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb\" (UID: \"5c6e095e-a029-4d55-999b-a4d9307835c8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" Jul 24 15:07:23.538455 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.538301 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c6e095e-a029-4d55-999b-a4d9307835c8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb\" (UID: \"5c6e095e-a029-4d55-999b-a4d9307835c8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" Jul 24 15:07:23.539058 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.539035 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c6e095e-a029-4d55-999b-a4d9307835c8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb\" (UID: \"5c6e095e-a029-4d55-999b-a4d9307835c8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" Jul 24 15:07:23.547726 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.547706 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chx9z\" (UniqueName: \"kubernetes.io/projected/5c6e095e-a029-4d55-999b-a4d9307835c8-kube-api-access-chx9z\") pod \"payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb\" (UID: \"5c6e095e-a029-4d55-999b-a4d9307835c8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" Jul 24 15:07:23.572588 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.572546 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" Jul 24 15:07:23.605022 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.604991 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" Jul 24 15:07:23.729645 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.729614 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j"] Jul 24 15:07:23.733042 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:07:23.732975 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc55462b1_bad9_4796_a11c_b929ed24975e.slice/crio-f417911d2a197dfd7f4fe0c2e76c07f58a97a52a247ba359ce948fe4ecb6192a WatchSource:0}: Error finding container f417911d2a197dfd7f4fe0c2e76c07f58a97a52a247ba359ce948fe4ecb6192a: Status 404 returned error can't find the container with id f417911d2a197dfd7f4fe0c2e76c07f58a97a52a247ba359ce948fe4ecb6192a Jul 24 15:07:23.767887 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:23.767813 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb"] Jul 24 15:07:23.770662 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:07:23.770634 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c6e095e_a029_4d55_999b_a4d9307835c8.slice/crio-205d22485e0301e17f78f260dc1908002bf94e2e97b724f405fb3ae788e4254a WatchSource:0}: Error finding container 205d22485e0301e17f78f260dc1908002bf94e2e97b724f405fb3ae788e4254a: Status 404 returned error can't find the container with id 205d22485e0301e17f78f260dc1908002bf94e2e97b724f405fb3ae788e4254a Jul 24 15:07:24.178554 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:24.178432 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" event={"ID":"5c6e095e-a029-4d55-999b-a4d9307835c8","Type":"ContainerStarted","Data":"25da1abc0ff7b6e5f9ae14c8ea266afef7b319eeea69542e7565b4f482616f7c"} Jul 24 15:07:24.178554 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:24.178498 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" event={"ID":"5c6e095e-a029-4d55-999b-a4d9307835c8","Type":"ContainerStarted","Data":"205d22485e0301e17f78f260dc1908002bf94e2e97b724f405fb3ae788e4254a"} Jul 24 15:07:24.178901 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:24.178644 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" Jul 24 15:07:24.180087 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:24.180058 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" event={"ID":"c55462b1-bad9-4796-a11c-b929ed24975e","Type":"ContainerStarted","Data":"2d1817afd8a2aaa2b9c8546b0cab69a10c271c5500bdb3b6b72860ea6a4f9649"} Jul 24 15:07:24.180209 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:24.180114 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" Jul 24 15:07:24.180209 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:24.180135 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" event={"ID":"c55462b1-bad9-4796-a11c-b929ed24975e","Type":"ContainerStarted","Data":"f417911d2a197dfd7f4fe0c2e76c07f58a97a52a247ba359ce948fe4ecb6192a"} Jul 24 15:07:24.198026 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:24.197980 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" podStartSLOduration=1.197965662 podStartE2EDuration="1.197965662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:07:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:07:24.196078148 +0000 UTC m=+2139.752994041" watchObservedRunningTime="2026-07-24 15:07:24.197965662 +0000 UTC m=+2139.754881554" Jul 24 15:07:24.214132 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:24.214087 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" podStartSLOduration=1.214068965 podStartE2EDuration="1.214068965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:07:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:07:24.213213835 +0000 UTC m=+2139.770129729" watchObservedRunningTime="2026-07-24 15:07:24.214068965 +0000 UTC m=+2139.770984861" Jul 24 15:07:27.548328 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.548293 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb"] Jul 24 15:07:27.552353 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.552326 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.555665 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.555639 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-97e60f-openshift-default-dockercfg-zf6p9\"" Jul 24 15:07:27.563856 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.563829 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb"] Jul 24 15:07:27.680907 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.680865 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-podinfo\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.680907 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.680904 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-data\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.681111 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.680927 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-workload-socket\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.681111 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.681017 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-workload-certs\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.681111 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.681060 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-envoy\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.681216 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.681114 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istiod-ca-cert\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.681216 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.681136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rgzj\" (UniqueName: \"kubernetes.io/projected/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-kube-api-access-7rgzj\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.681216 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.681193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-token\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.681317 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.681229 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-credential-socket\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.782312 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.782273 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-podinfo\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.782312 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.782312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-data\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.782593 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.782332 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-workload-socket\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.782593 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.782361 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-workload-certs\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.782593 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.782396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-envoy\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.782593 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.782424 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istiod-ca-cert\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.782593 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.782444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rgzj\" (UniqueName: \"kubernetes.io/projected/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-kube-api-access-7rgzj\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.782593 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.782469 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-token\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.782593 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.782493 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-credential-socket\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.782996 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.782780 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-workload-socket\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.782996 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.782900 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-credential-socket\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.783105 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.783068 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-workload-certs\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.783161 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.783114 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-data\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.783287 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.783269 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istiod-ca-cert\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.784929 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.784911 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-envoy\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.785028 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.785012 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-podinfo\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.791483 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.791454 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-token\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.791621 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.791513 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rgzj\" (UniqueName: \"kubernetes.io/projected/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-kube-api-access-7rgzj\") pod \"e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:27.865956 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:27.865873 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:28.009479 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:28.009454 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb"] Jul 24 15:07:28.011806 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:07:28.011780 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6663c7f_e06d_4647_928c_ca1e87fcf7a5.slice/crio-c6885d17e68397dce0d7b25b65e01c5e6278f18320295926f4d0ce851c5342bb WatchSource:0}: Error finding container c6885d17e68397dce0d7b25b65e01c5e6278f18320295926f4d0ce851c5342bb: Status 404 returned error can't find the container with id c6885d17e68397dce0d7b25b65e01c5e6278f18320295926f4d0ce851c5342bb Jul 24 15:07:28.014289 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:28.014244 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:07:28.014368 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:28.014344 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:07:28.014412 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:28.014390 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:07:28.204695 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:28.204600 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" event={"ID":"c6663c7f-e06d-4647-928c-ca1e87fcf7a5","Type":"ContainerStarted","Data":"7f95d5c130252d2e107e1018e8768274002762c05808443210460f3ab782f04e"} Jul 24 15:07:28.204695 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:28.204658 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" event={"ID":"c6663c7f-e06d-4647-928c-ca1e87fcf7a5","Type":"ContainerStarted","Data":"c6885d17e68397dce0d7b25b65e01c5e6278f18320295926f4d0ce851c5342bb"} Jul 24 15:07:28.227166 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:28.227113 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" podStartSLOduration=1.227098759 podStartE2EDuration="1.227098759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:07:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:07:28.225838085 +0000 UTC m=+2143.782753976" watchObservedRunningTime="2026-07-24 15:07:28.227098759 +0000 UTC m=+2143.784014650" Jul 24 15:07:28.866549 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:28.866493 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:29.873100 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:29.873065 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:30.216921 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:30.216848 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:30.218138 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:30.218114 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:35.188643 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:35.188605 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" Jul 24 15:07:35.189127 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:35.188685 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" Jul 24 15:07:36.162985 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:36.162877 2581 patch_prober.go:28] interesting pod/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 24 15:07:36.163219 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:36.162993 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" podUID="c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 24 15:07:36.257604 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:36.257563 2581 generic.go:356] "Generic (PLEG): container finished" podID="c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" containerID="fc1f5216a6b20d4868f3b093ff029dd4e898bd8ffc998c8293a4436420b3546a" exitCode=0 Jul 24 15:07:36.258272 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:36.258246 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" event={"ID":"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79","Type":"ContainerDied","Data":"fc1f5216a6b20d4868f3b093ff029dd4e898bd8ffc998c8293a4436420b3546a"} Jul 24 15:07:36.258932 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:36.258908 2581 scope.go:117] "RemoveContainer" containerID="fc1f5216a6b20d4868f3b093ff029dd4e898bd8ffc998c8293a4436420b3546a" Jul 24 15:07:36.261609 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:36.261215 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:07:36.261609 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:36.261319 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:07:36.261609 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:36.261384 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:07:37.269356 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:37.269254 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" event={"ID":"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79","Type":"ContainerStarted","Data":"e402db39419e2fbec1b6daef6fdc610ddd72022c66c50fa0e31e87d7d3475f02"} Jul 24 15:07:38.001729 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:38.001687 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:38.001912 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:38.001736 2581 patch_prober.go:28] interesting pod/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 24 15:07:38.001912 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:38.001779 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" podUID="c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 24 15:07:39.001843 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:39.001803 2581 patch_prober.go:28] interesting pod/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 24 15:07:39.002245 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:39.001879 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" podUID="c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 24 15:07:40.002725 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:40.002632 2581 patch_prober.go:28] interesting pod/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 24 15:07:40.002725 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:40.002703 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" podUID="c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 24 15:07:41.002484 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:41.002448 2581 patch_prober.go:28] interesting pod/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 24 15:07:41.002703 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:41.002509 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" podUID="c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 24 15:07:42.006367 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:42.006333 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:42.006771 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:42.006660 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:42.007589 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:42.007568 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:07:43.309227 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:43.309197 2581 generic.go:356] "Generic (PLEG): container finished" podID="c6663c7f-e06d-4647-928c-ca1e87fcf7a5" containerID="7f95d5c130252d2e107e1018e8768274002762c05808443210460f3ab782f04e" exitCode=0 Jul 24 15:07:43.309666 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:43.309267 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" event={"ID":"c6663c7f-e06d-4647-928c-ca1e87fcf7a5","Type":"ContainerDied","Data":"7f95d5c130252d2e107e1018e8768274002762c05808443210460f3ab782f04e"} Jul 24 15:07:43.309827 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:43.309811 2581 scope.go:117] "RemoveContainer" containerID="7f95d5c130252d2e107e1018e8768274002762c05808443210460f3ab782f04e" Jul 24 15:07:43.310844 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:43.310818 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:07:43.310923 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:43.310883 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:07:43.310923 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:43.310913 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:07:44.316205 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:44.316168 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" event={"ID":"c6663c7f-e06d-4647-928c-ca1e87fcf7a5","Type":"ContainerStarted","Data":"2d1a4fb5b56980b7628a29d180f583ff24c05c8ad93bc8b7a3d5f2470271fe3f"} Jul 24 15:07:44.866942 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:44.866903 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:44.867999 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:44.867966 2581 patch_prober.go:28] interesting pod/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 24 15:07:44.868222 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:44.868196 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" podUID="c6663c7f-e06d-4647-928c-ca1e87fcf7a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 24 15:07:45.217741 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:45.217662 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:45.869514 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:45.868988 2581 patch_prober.go:28] interesting pod/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 24 15:07:45.869514 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:45.869072 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" podUID="c6663c7f-e06d-4647-928c-ca1e87fcf7a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 24 15:07:46.866803 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:46.866760 2581 patch_prober.go:28] interesting pod/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 24 15:07:46.867132 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:46.867083 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" podUID="c6663c7f-e06d-4647-928c-ca1e87fcf7a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 24 15:07:47.866973 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:47.866493 2581 patch_prober.go:28] interesting pod/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 24 15:07:47.866973 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:47.866586 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" podUID="c6663c7f-e06d-4647-928c-ca1e87fcf7a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 24 15:07:48.870126 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:48.870093 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:07:48.871276 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:07:48.871253 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:09:16.672008 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:16.671921 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb"] Jul 24 15:09:16.672574 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:16.672175 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" podUID="5c6e095e-a029-4d55-999b-a4d9307835c8" containerName="payload-processing" containerID="cri-o://25da1abc0ff7b6e5f9ae14c8ea266afef7b319eeea69542e7565b4f482616f7c" gracePeriod=30 Jul 24 15:09:16.678690 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:16.678661 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j"] Jul 24 15:09:16.679191 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:16.679138 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" podUID="c55462b1-bad9-4796-a11c-b929ed24975e" containerName="payload-pre-processing" containerID="cri-o://2d1817afd8a2aaa2b9c8546b0cab69a10c271c5500bdb3b6b72860ea6a4f9649" gracePeriod=30 Jul 24 15:09:16.829918 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:16.829783 2581 generic.go:356] "Generic (PLEG): container finished" podID="c55462b1-bad9-4796-a11c-b929ed24975e" containerID="2d1817afd8a2aaa2b9c8546b0cab69a10c271c5500bdb3b6b72860ea6a4f9649" exitCode=0 Jul 24 15:09:16.829918 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:16.829898 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" event={"ID":"c55462b1-bad9-4796-a11c-b929ed24975e","Type":"ContainerDied","Data":"2d1817afd8a2aaa2b9c8546b0cab69a10c271c5500bdb3b6b72860ea6a4f9649"} Jul 24 15:09:16.832262 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:16.832123 2581 generic.go:356] "Generic (PLEG): container finished" podID="5c6e095e-a029-4d55-999b-a4d9307835c8" containerID="25da1abc0ff7b6e5f9ae14c8ea266afef7b319eeea69542e7565b4f482616f7c" exitCode=0 Jul 24 15:09:16.832262 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:16.832197 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" event={"ID":"5c6e095e-a029-4d55-999b-a4d9307835c8","Type":"ContainerDied","Data":"25da1abc0ff7b6e5f9ae14c8ea266afef7b319eeea69542e7565b4f482616f7c"} Jul 24 15:09:16.989076 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:16.989049 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" Jul 24 15:09:16.992271 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:16.992250 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" Jul 24 15:09:17.059992 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.059961 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chx9z\" (UniqueName: \"kubernetes.io/projected/5c6e095e-a029-4d55-999b-a4d9307835c8-kube-api-access-chx9z\") pod \"5c6e095e-a029-4d55-999b-a4d9307835c8\" (UID: \"5c6e095e-a029-4d55-999b-a4d9307835c8\") " Jul 24 15:09:17.060162 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.060020 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c55462b1-bad9-4796-a11c-b929ed24975e-plugins-config-volume\") pod \"c55462b1-bad9-4796-a11c-b929ed24975e\" (UID: \"c55462b1-bad9-4796-a11c-b929ed24975e\") " Jul 24 15:09:17.060162 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.060068 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c6e095e-a029-4d55-999b-a4d9307835c8-plugins-config-volume\") pod \"5c6e095e-a029-4d55-999b-a4d9307835c8\" (UID: \"5c6e095e-a029-4d55-999b-a4d9307835c8\") " Jul 24 15:09:17.060280 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.060170 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxhdm\" (UniqueName: \"kubernetes.io/projected/c55462b1-bad9-4796-a11c-b929ed24975e-kube-api-access-jxhdm\") pod \"c55462b1-bad9-4796-a11c-b929ed24975e\" (UID: \"c55462b1-bad9-4796-a11c-b929ed24975e\") " Jul 24 15:09:17.060510 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.060474 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c55462b1-bad9-4796-a11c-b929ed24975e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c55462b1-bad9-4796-a11c-b929ed24975e" (UID: "c55462b1-bad9-4796-a11c-b929ed24975e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:09:17.060651 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.060580 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c6e095e-a029-4d55-999b-a4d9307835c8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5c6e095e-a029-4d55-999b-a4d9307835c8" (UID: "5c6e095e-a029-4d55-999b-a4d9307835c8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:09:17.062299 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.062271 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c6e095e-a029-4d55-999b-a4d9307835c8-kube-api-access-chx9z" (OuterVolumeSpecName: "kube-api-access-chx9z") pod "5c6e095e-a029-4d55-999b-a4d9307835c8" (UID: "5c6e095e-a029-4d55-999b-a4d9307835c8"). InnerVolumeSpecName "kube-api-access-chx9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:09:17.062501 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.062476 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c55462b1-bad9-4796-a11c-b929ed24975e-kube-api-access-jxhdm" (OuterVolumeSpecName: "kube-api-access-jxhdm") pod "c55462b1-bad9-4796-a11c-b929ed24975e" (UID: "c55462b1-bad9-4796-a11c-b929ed24975e"). InnerVolumeSpecName "kube-api-access-jxhdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:09:17.161489 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.161453 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxhdm\" (UniqueName: \"kubernetes.io/projected/c55462b1-bad9-4796-a11c-b929ed24975e-kube-api-access-jxhdm\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:17.161489 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.161483 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chx9z\" (UniqueName: \"kubernetes.io/projected/5c6e095e-a029-4d55-999b-a4d9307835c8-kube-api-access-chx9z\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:17.161489 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.161492 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c55462b1-bad9-4796-a11c-b929ed24975e-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:17.161764 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.161503 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c6e095e-a029-4d55-999b-a4d9307835c8-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:17.838814 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.838784 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" Jul 24 15:09:17.838814 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.838800 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j" event={"ID":"c55462b1-bad9-4796-a11c-b929ed24975e","Type":"ContainerDied","Data":"f417911d2a197dfd7f4fe0c2e76c07f58a97a52a247ba359ce948fe4ecb6192a"} Jul 24 15:09:17.839348 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.838871 2581 scope.go:117] "RemoveContainer" containerID="2d1817afd8a2aaa2b9c8546b0cab69a10c271c5500bdb3b6b72860ea6a4f9649" Jul 24 15:09:17.840247 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.840127 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" Jul 24 15:09:17.840247 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.840168 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb" event={"ID":"5c6e095e-a029-4d55-999b-a4d9307835c8","Type":"ContainerDied","Data":"205d22485e0301e17f78f260dc1908002bf94e2e97b724f405fb3ae788e4254a"} Jul 24 15:09:17.850456 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.850387 2581 scope.go:117] "RemoveContainer" containerID="25da1abc0ff7b6e5f9ae14c8ea266afef7b319eeea69542e7565b4f482616f7c" Jul 24 15:09:17.866785 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.866758 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb"] Jul 24 15:09:17.870453 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.870427 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-39743c-7f9cf4b484-6z6nb"] Jul 24 15:09:17.882867 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.882841 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j"] Jul 24 15:09:17.888096 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:17.888073 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-39743c-6f9756cc44-zqc4j"] Jul 24 15:09:18.972903 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:18.972871 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c6e095e-a029-4d55-999b-a4d9307835c8" path="/var/lib/kubelet/pods/5c6e095e-a029-4d55-999b-a4d9307835c8/volumes" Jul 24 15:09:18.973317 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:18.973224 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c55462b1-bad9-4796-a11c-b929ed24975e" path="/var/lib/kubelet/pods/c55462b1-bad9-4796-a11c-b929ed24975e/volumes" Jul 24 15:09:28.163587 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:28.163550 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v"] Jul 24 15:09:28.164116 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:28.163781 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" podUID="c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" containerName="istio-proxy" containerID="cri-o://e402db39419e2fbec1b6daef6fdc610ddd72022c66c50fa0e31e87d7d3475f02" gracePeriod=30 Jul 24 15:09:33.418921 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.418893 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:09:33.517406 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.517313 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istiod-ca-cert\") pod \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " Jul 24 15:09:33.517406 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.517363 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-envoy\") pod \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " Jul 24 15:09:33.517406 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.517380 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-workload-certs\") pod \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " Jul 24 15:09:33.517406 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.517403 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-data\") pod \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " Jul 24 15:09:33.517780 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.517432 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-podinfo\") pod \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " Jul 24 15:09:33.517780 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.517522 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-workload-socket\") pod \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " Jul 24 15:09:33.517780 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.517599 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-token\") pod \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " Jul 24 15:09:33.517780 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.517630 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-credential-socket\") pod \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " Jul 24 15:09:33.517780 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.517677 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8npv\" (UniqueName: \"kubernetes.io/projected/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-kube-api-access-r8npv\") pod \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\" (UID: \"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79\") " Jul 24 15:09:33.517780 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.517764 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" (UID: "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:09:33.518105 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.517883 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" (UID: "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:09:33.518105 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.517804 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" (UID: "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:09:33.518105 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.517999 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" (UID: "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:09:33.518105 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.518066 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istiod-ca-cert\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:33.518105 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.518087 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-workload-certs\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:33.518105 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.518101 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-workload-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:33.518775 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.518751 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-data" (OuterVolumeSpecName: "istio-data") pod "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" (UID: "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:09:33.519661 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.519641 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" (UID: "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:09:33.519843 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.519822 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-kube-api-access-r8npv" (OuterVolumeSpecName: "kube-api-access-r8npv") pod "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" (UID: "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79"). InnerVolumeSpecName "kube-api-access-r8npv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:09:33.520119 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.520091 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-token" (OuterVolumeSpecName: "istio-token") pod "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" (UID: "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:09:33.520119 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.520103 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" (UID: "c2ad21ea-5729-4ef7-bcf1-b49cc68aba79"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 15:09:33.619513 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.619460 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8npv\" (UniqueName: \"kubernetes.io/projected/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-kube-api-access-r8npv\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:33.619513 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.619505 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-envoy\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:33.619513 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.619515 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-data\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:33.619513 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.619523 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-podinfo\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:33.619513 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.619553 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-istio-token\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:33.619513 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.619561 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79-credential-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:33.926224 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.926190 2581 generic.go:356] "Generic (PLEG): container finished" podID="c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" containerID="e402db39419e2fbec1b6daef6fdc610ddd72022c66c50fa0e31e87d7d3475f02" exitCode=0 Jul 24 15:09:33.926406 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.926238 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" Jul 24 15:09:33.926406 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.926277 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" event={"ID":"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79","Type":"ContainerDied","Data":"e402db39419e2fbec1b6daef6fdc610ddd72022c66c50fa0e31e87d7d3475f02"} Jul 24 15:09:33.926406 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.926359 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v" event={"ID":"c2ad21ea-5729-4ef7-bcf1-b49cc68aba79","Type":"ContainerDied","Data":"ac7b76719c6d98c1bd022cf626c7060a31afed6597f10e22393ef4991981f456"} Jul 24 15:09:33.926406 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.926382 2581 scope.go:117] "RemoveContainer" containerID="e402db39419e2fbec1b6daef6fdc610ddd72022c66c50fa0e31e87d7d3475f02" Jul 24 15:09:33.936107 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.936091 2581 scope.go:117] "RemoveContainer" containerID="fc1f5216a6b20d4868f3b093ff029dd4e898bd8ffc998c8293a4436420b3546a" Jul 24 15:09:33.944267 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.944248 2581 scope.go:117] "RemoveContainer" containerID="e402db39419e2fbec1b6daef6fdc610ddd72022c66c50fa0e31e87d7d3475f02" Jul 24 15:09:33.944509 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:09:33.944487 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e402db39419e2fbec1b6daef6fdc610ddd72022c66c50fa0e31e87d7d3475f02\": container with ID starting with e402db39419e2fbec1b6daef6fdc610ddd72022c66c50fa0e31e87d7d3475f02 not found: ID does not exist" containerID="e402db39419e2fbec1b6daef6fdc610ddd72022c66c50fa0e31e87d7d3475f02" Jul 24 15:09:33.944603 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.944523 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e402db39419e2fbec1b6daef6fdc610ddd72022c66c50fa0e31e87d7d3475f02"} err="failed to get container status \"e402db39419e2fbec1b6daef6fdc610ddd72022c66c50fa0e31e87d7d3475f02\": rpc error: code = NotFound desc = could not find container \"e402db39419e2fbec1b6daef6fdc610ddd72022c66c50fa0e31e87d7d3475f02\": container with ID starting with e402db39419e2fbec1b6daef6fdc610ddd72022c66c50fa0e31e87d7d3475f02 not found: ID does not exist" Jul 24 15:09:33.944603 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.944562 2581 scope.go:117] "RemoveContainer" containerID="fc1f5216a6b20d4868f3b093ff029dd4e898bd8ffc998c8293a4436420b3546a" Jul 24 15:09:33.944821 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:09:33.944804 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc1f5216a6b20d4868f3b093ff029dd4e898bd8ffc998c8293a4436420b3546a\": container with ID starting with fc1f5216a6b20d4868f3b093ff029dd4e898bd8ffc998c8293a4436420b3546a not found: ID does not exist" containerID="fc1f5216a6b20d4868f3b093ff029dd4e898bd8ffc998c8293a4436420b3546a" Jul 24 15:09:33.944867 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.944825 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc1f5216a6b20d4868f3b093ff029dd4e898bd8ffc998c8293a4436420b3546a"} err="failed to get container status \"fc1f5216a6b20d4868f3b093ff029dd4e898bd8ffc998c8293a4436420b3546a\": rpc error: code = NotFound desc = could not find container \"fc1f5216a6b20d4868f3b093ff029dd4e898bd8ffc998c8293a4436420b3546a\": container with ID starting with fc1f5216a6b20d4868f3b093ff029dd4e898bd8ffc998c8293a4436420b3546a not found: ID does not exist" Jul 24 15:09:33.948943 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.948920 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v"] Jul 24 15:09:33.952562 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:33.952523 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-39743c-openshift-default-6f9d78fcb4-h8q6v"] Jul 24 15:09:34.972267 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:34.972238 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" path="/var/lib/kubelet/pods/c2ad21ea-5729-4ef7-bcf1-b49cc68aba79/volumes" Jul 24 15:09:50.373948 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:50.373915 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb"] Jul 24 15:09:50.374578 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:50.374168 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" podUID="c6663c7f-e06d-4647-928c-ca1e87fcf7a5" containerName="istio-proxy" containerID="cri-o://2d1a4fb5b56980b7628a29d180f583ff24c05c8ad93bc8b7a3d5f2470271fe3f" gracePeriod=30 Jul 24 15:09:51.299431 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.299363 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd"] Jul 24 15:09:51.299926 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.299908 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" containerName="istio-proxy" Jul 24 15:09:51.299926 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.299927 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" containerName="istio-proxy" Jul 24 15:09:51.300049 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.299936 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c6e095e-a029-4d55-999b-a4d9307835c8" containerName="payload-processing" Jul 24 15:09:51.300049 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.299943 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c6e095e-a029-4d55-999b-a4d9307835c8" containerName="payload-processing" Jul 24 15:09:51.300049 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.299966 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" containerName="istio-proxy" Jul 24 15:09:51.300049 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.299973 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" containerName="istio-proxy" Jul 24 15:09:51.300049 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.299981 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55462b1-bad9-4796-a11c-b929ed24975e" containerName="payload-pre-processing" Jul 24 15:09:51.300049 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.299987 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55462b1-bad9-4796-a11c-b929ed24975e" containerName="payload-pre-processing" Jul 24 15:09:51.300249 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.300058 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" containerName="istio-proxy" Jul 24 15:09:51.300249 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.300067 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c55462b1-bad9-4796-a11c-b929ed24975e" containerName="payload-pre-processing" Jul 24 15:09:51.300249 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.300074 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c6e095e-a029-4d55-999b-a4d9307835c8" containerName="payload-processing" Jul 24 15:09:51.304871 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.304852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.307595 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.307574 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b1e6f9-openshift-default-dockercfg-8cgfd\"" Jul 24 15:09:51.316883 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.316855 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd"] Jul 24 15:09:51.384947 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.384911 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-workload-certs\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.384947 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.384953 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bfee445-195e-435a-9da3-8f150e051758-istiod-ca-cert\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.385511 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.384986 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bfee445-195e-435a-9da3-8f150e051758-istio-token\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.385511 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.385061 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bfee445-195e-435a-9da3-8f150e051758-istio-podinfo\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.385511 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.385152 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-credential-socket\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.385511 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.385195 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-workload-socket\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.385511 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.385221 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-istio-data\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.385511 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.385265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-istio-envoy\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.385511 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.385332 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kscpk\" (UniqueName: \"kubernetes.io/projected/2bfee445-195e-435a-9da3-8f150e051758-kube-api-access-kscpk\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.485820 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.485781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bfee445-195e-435a-9da3-8f150e051758-istio-podinfo\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.486022 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.485850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-credential-socket\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.486022 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.485883 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-workload-socket\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.486022 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.485908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-istio-data\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.486022 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.485939 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-istio-envoy\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.486022 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.485994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kscpk\" (UniqueName: \"kubernetes.io/projected/2bfee445-195e-435a-9da3-8f150e051758-kube-api-access-kscpk\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.486297 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.486039 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-workload-certs\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.486297 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.486283 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-credential-socket\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.486397 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.486341 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-workload-socket\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.486397 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.486351 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-istio-data\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.486397 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.486385 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bfee445-195e-435a-9da3-8f150e051758-istiod-ca-cert\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.486606 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.486425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bfee445-195e-435a-9da3-8f150e051758-istio-token\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.486709 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.486664 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-workload-certs\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.487123 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.487095 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bfee445-195e-435a-9da3-8f150e051758-istiod-ca-cert\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.488656 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.488635 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bfee445-195e-435a-9da3-8f150e051758-istio-podinfo\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.488656 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.488648 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-istio-envoy\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.506406 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.506374 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bfee445-195e-435a-9da3-8f150e051758-istio-token\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.506551 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.506516 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kscpk\" (UniqueName: \"kubernetes.io/projected/2bfee445-195e-435a-9da3-8f150e051758-kube-api-access-kscpk\") pod \"e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.617406 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.617308 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:51.764813 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.764783 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd"] Jul 24 15:09:51.767053 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:09:51.767025 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bfee445_195e_435a_9da3_8f150e051758.slice/crio-6291edd4cd6116686f845f1782c9dd1db5b799a8f2dd1b595e22afef03daf4df WatchSource:0}: Error finding container 6291edd4cd6116686f845f1782c9dd1db5b799a8f2dd1b595e22afef03daf4df: Status 404 returned error can't find the container with id 6291edd4cd6116686f845f1782c9dd1db5b799a8f2dd1b595e22afef03daf4df Jul 24 15:09:51.769271 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.769241 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:09:51.769320 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.769304 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:09:51.769364 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:51.769336 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:09:52.022737 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:52.022648 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" event={"ID":"2bfee445-195e-435a-9da3-8f150e051758","Type":"ContainerStarted","Data":"9f57cc28da98cb861bcb62a2a099ac572cf1f0fc4003f64932f83957172a03d3"} Jul 24 15:09:52.022737 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:52.022703 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" event={"ID":"2bfee445-195e-435a-9da3-8f150e051758","Type":"ContainerStarted","Data":"6291edd4cd6116686f845f1782c9dd1db5b799a8f2dd1b595e22afef03daf4df"} Jul 24 15:09:52.045720 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:52.045664 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" podStartSLOduration=1.045643236 podStartE2EDuration="1.045643236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:09:52.043170055 +0000 UTC m=+2287.600085989" watchObservedRunningTime="2026-07-24 15:09:52.045643236 +0000 UTC m=+2287.602559129" Jul 24 15:09:52.617662 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:52.617628 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:52.622891 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:52.622859 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:53.027935 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:53.027844 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:53.028879 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:53.028860 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:09:54.996480 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:54.996441 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb"] Jul 24 15:09:54.997129 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:54.997108 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2ad21ea-5729-4ef7-bcf1-b49cc68aba79" containerName="istio-proxy" Jul 24 15:09:55.000235 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.000214 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" Jul 24 15:09:55.003938 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.003899 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-b1e6f9\"" Jul 24 15:09:55.004057 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.004040 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-b1e6f9-dockercfg-tqpsf\"" Jul 24 15:09:55.019157 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.019130 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb"] Jul 24 15:09:55.122591 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.122196 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8ad8792-5723-4c9a-ad19-1d44e6616e15-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb\" (UID: \"e8ad8792-5723-4c9a-ad19-1d44e6616e15\") " pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" Jul 24 15:09:55.122591 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.122275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlmqw\" (UniqueName: \"kubernetes.io/projected/e8ad8792-5723-4c9a-ad19-1d44e6616e15-kube-api-access-mlmqw\") pod \"payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb\" (UID: \"e8ad8792-5723-4c9a-ad19-1d44e6616e15\") " pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" Jul 24 15:09:55.223102 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.223065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8ad8792-5723-4c9a-ad19-1d44e6616e15-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb\" (UID: \"e8ad8792-5723-4c9a-ad19-1d44e6616e15\") " pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" Jul 24 15:09:55.223268 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.223118 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlmqw\" (UniqueName: \"kubernetes.io/projected/e8ad8792-5723-4c9a-ad19-1d44e6616e15-kube-api-access-mlmqw\") pod \"payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb\" (UID: \"e8ad8792-5723-4c9a-ad19-1d44e6616e15\") " pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" Jul 24 15:09:55.223770 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.223749 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8ad8792-5723-4c9a-ad19-1d44e6616e15-plugins-config-volume\") pod \"payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb\" (UID: \"e8ad8792-5723-4c9a-ad19-1d44e6616e15\") " pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" Jul 24 15:09:55.233954 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.233930 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlmqw\" (UniqueName: \"kubernetes.io/projected/e8ad8792-5723-4c9a-ad19-1d44e6616e15-kube-api-access-mlmqw\") pod \"payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb\" (UID: \"e8ad8792-5723-4c9a-ad19-1d44e6616e15\") " pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" Jul 24 15:09:55.311484 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.311456 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" Jul 24 15:09:55.476164 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:09:55.476116 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ad8792_5723_4c9a_ad19_1d44e6616e15.slice/crio-3ae09b92baf25403dd91faf4bc8a460cc27dcbb2411b9e9ba403362f722b41c4 WatchSource:0}: Error finding container 3ae09b92baf25403dd91faf4bc8a460cc27dcbb2411b9e9ba403362f722b41c4: Status 404 returned error can't find the container with id 3ae09b92baf25403dd91faf4bc8a460cc27dcbb2411b9e9ba403362f722b41c4 Jul 24 15:09:55.484952 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.484928 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb"] Jul 24 15:09:55.620358 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.620334 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:09:55.727606 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.727572 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-workload-socket\") pod \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " Jul 24 15:09:55.727813 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.727619 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-podinfo\") pod \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " Jul 24 15:09:55.727813 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.727661 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-data\") pod \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " Jul 24 15:09:55.727813 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.727704 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-token\") pod \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " Jul 24 15:09:55.727813 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.727721 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-envoy\") pod \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " Jul 24 15:09:55.727813 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.727797 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-workload-certs\") pod \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " Jul 24 15:09:55.728084 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.727831 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rgzj\" (UniqueName: \"kubernetes.io/projected/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-kube-api-access-7rgzj\") pod \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " Jul 24 15:09:55.728084 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.727867 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istiod-ca-cert\") pod \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " Jul 24 15:09:55.728084 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.727890 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-credential-socket\") pod \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\" (UID: \"c6663c7f-e06d-4647-928c-ca1e87fcf7a5\") " Jul 24 15:09:55.728084 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.727934 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c6663c7f-e06d-4647-928c-ca1e87fcf7a5" (UID: "c6663c7f-e06d-4647-928c-ca1e87fcf7a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:09:55.728276 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.728166 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c6663c7f-e06d-4647-928c-ca1e87fcf7a5" (UID: "c6663c7f-e06d-4647-928c-ca1e87fcf7a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:09:55.728276 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.728230 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-workload-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:55.728482 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.728459 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c6663c7f-e06d-4647-928c-ca1e87fcf7a5" (UID: "c6663c7f-e06d-4647-928c-ca1e87fcf7a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:09:55.728767 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.728747 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c6663c7f-e06d-4647-928c-ca1e87fcf7a5" (UID: "c6663c7f-e06d-4647-928c-ca1e87fcf7a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:09:55.728893 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.728876 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-data" (OuterVolumeSpecName: "istio-data") pod "c6663c7f-e06d-4647-928c-ca1e87fcf7a5" (UID: "c6663c7f-e06d-4647-928c-ca1e87fcf7a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:09:55.730119 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.730102 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-kube-api-access-7rgzj" (OuterVolumeSpecName: "kube-api-access-7rgzj") pod "c6663c7f-e06d-4647-928c-ca1e87fcf7a5" (UID: "c6663c7f-e06d-4647-928c-ca1e87fcf7a5"). InnerVolumeSpecName "kube-api-access-7rgzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:09:55.730206 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.730138 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c6663c7f-e06d-4647-928c-ca1e87fcf7a5" (UID: "c6663c7f-e06d-4647-928c-ca1e87fcf7a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 15:09:55.730347 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.730331 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "c6663c7f-e06d-4647-928c-ca1e87fcf7a5" (UID: "c6663c7f-e06d-4647-928c-ca1e87fcf7a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:09:55.730408 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.730341 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c6663c7f-e06d-4647-928c-ca1e87fcf7a5" (UID: "c6663c7f-e06d-4647-928c-ca1e87fcf7a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:09:55.829609 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.829569 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-token\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:55.829609 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.829603 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-envoy\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:55.829609 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.829618 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-workload-certs\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:55.829866 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.829629 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rgzj\" (UniqueName: \"kubernetes.io/projected/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-kube-api-access-7rgzj\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:55.829866 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.829642 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istiod-ca-cert\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:55.829866 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.829654 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-credential-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:55.829866 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.829664 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-podinfo\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:55.829866 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:55.829674 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6663c7f-e06d-4647-928c-ca1e87fcf7a5-istio-data\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:09:56.045195 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.045143 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" event={"ID":"e8ad8792-5723-4c9a-ad19-1d44e6616e15","Type":"ContainerStarted","Data":"be500d2d4b4f41c8b857d3ba5c096e57252872ac6fa247078992d1fa15bb64dc"} Jul 24 15:09:56.045693 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.045211 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" event={"ID":"e8ad8792-5723-4c9a-ad19-1d44e6616e15","Type":"ContainerStarted","Data":"3ae09b92baf25403dd91faf4bc8a460cc27dcbb2411b9e9ba403362f722b41c4"} Jul 24 15:09:56.045693 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.045241 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" Jul 24 15:09:56.047092 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.047062 2581 generic.go:356] "Generic (PLEG): container finished" podID="c6663c7f-e06d-4647-928c-ca1e87fcf7a5" containerID="2d1a4fb5b56980b7628a29d180f583ff24c05c8ad93bc8b7a3d5f2470271fe3f" exitCode=0 Jul 24 15:09:56.047253 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.047101 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" Jul 24 15:09:56.047253 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.047144 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" event={"ID":"c6663c7f-e06d-4647-928c-ca1e87fcf7a5","Type":"ContainerDied","Data":"2d1a4fb5b56980b7628a29d180f583ff24c05c8ad93bc8b7a3d5f2470271fe3f"} Jul 24 15:09:56.047253 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.047203 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb" event={"ID":"c6663c7f-e06d-4647-928c-ca1e87fcf7a5","Type":"ContainerDied","Data":"c6885d17e68397dce0d7b25b65e01c5e6278f18320295926f4d0ce851c5342bb"} Jul 24 15:09:56.047253 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.047237 2581 scope.go:117] "RemoveContainer" containerID="2d1a4fb5b56980b7628a29d180f583ff24c05c8ad93bc8b7a3d5f2470271fe3f" Jul 24 15:09:56.058816 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.058796 2581 scope.go:117] "RemoveContainer" containerID="7f95d5c130252d2e107e1018e8768274002762c05808443210460f3ab782f04e" Jul 24 15:09:56.066811 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.066783 2581 scope.go:117] "RemoveContainer" containerID="2d1a4fb5b56980b7628a29d180f583ff24c05c8ad93bc8b7a3d5f2470271fe3f" Jul 24 15:09:56.067079 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:09:56.067045 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d1a4fb5b56980b7628a29d180f583ff24c05c8ad93bc8b7a3d5f2470271fe3f\": container with ID starting with 2d1a4fb5b56980b7628a29d180f583ff24c05c8ad93bc8b7a3d5f2470271fe3f not found: ID does not exist" containerID="2d1a4fb5b56980b7628a29d180f583ff24c05c8ad93bc8b7a3d5f2470271fe3f" Jul 24 15:09:56.067148 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.067091 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d1a4fb5b56980b7628a29d180f583ff24c05c8ad93bc8b7a3d5f2470271fe3f"} err="failed to get container status \"2d1a4fb5b56980b7628a29d180f583ff24c05c8ad93bc8b7a3d5f2470271fe3f\": rpc error: code = NotFound desc = could not find container \"2d1a4fb5b56980b7628a29d180f583ff24c05c8ad93bc8b7a3d5f2470271fe3f\": container with ID starting with 2d1a4fb5b56980b7628a29d180f583ff24c05c8ad93bc8b7a3d5f2470271fe3f not found: ID does not exist" Jul 24 15:09:56.067148 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.067116 2581 scope.go:117] "RemoveContainer" containerID="7f95d5c130252d2e107e1018e8768274002762c05808443210460f3ab782f04e" Jul 24 15:09:56.067417 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:09:56.067400 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f95d5c130252d2e107e1018e8768274002762c05808443210460f3ab782f04e\": container with ID starting with 7f95d5c130252d2e107e1018e8768274002762c05808443210460f3ab782f04e not found: ID does not exist" containerID="7f95d5c130252d2e107e1018e8768274002762c05808443210460f3ab782f04e" Jul 24 15:09:56.067468 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.067422 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f95d5c130252d2e107e1018e8768274002762c05808443210460f3ab782f04e"} err="failed to get container status \"7f95d5c130252d2e107e1018e8768274002762c05808443210460f3ab782f04e\": rpc error: code = NotFound desc = could not find container \"7f95d5c130252d2e107e1018e8768274002762c05808443210460f3ab782f04e\": container with ID starting with 7f95d5c130252d2e107e1018e8768274002762c05808443210460f3ab782f04e not found: ID does not exist" Jul 24 15:09:56.078507 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.078467 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" podStartSLOduration=2.078451971 podStartE2EDuration="2.078451971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:09:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:09:56.075992736 +0000 UTC m=+2291.632908628" watchObservedRunningTime="2026-07-24 15:09:56.078451971 +0000 UTC m=+2291.635367864" Jul 24 15:09:56.094807 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.094783 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb"] Jul 24 15:09:56.099165 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.099144 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-97e60f-openshift-default-cb7d89ff4-zcpsb"] Jul 24 15:09:56.973554 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:56.973461 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6663c7f-e06d-4647-928c-ca1e87fcf7a5" path="/var/lib/kubelet/pods/c6663c7f-e06d-4647-928c-ca1e87fcf7a5/volumes" Jul 24 15:09:59.326328 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.326289 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg"] Jul 24 15:09:59.326938 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.326718 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6663c7f-e06d-4647-928c-ca1e87fcf7a5" containerName="istio-proxy" Jul 24 15:09:59.326938 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.326731 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6663c7f-e06d-4647-928c-ca1e87fcf7a5" containerName="istio-proxy" Jul 24 15:09:59.326938 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.326814 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6663c7f-e06d-4647-928c-ca1e87fcf7a5" containerName="istio-proxy" Jul 24 15:09:59.331323 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.331300 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.334454 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.334429 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-b3c385-openshift-default-dockercfg-k6snz\"" Jul 24 15:09:59.346791 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.346693 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg"] Jul 24 15:09:59.467703 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.467654 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac338bb6-d44c-4c72-81df-81214879277c-istio-podinfo\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.467887 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.467721 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-workload-socket\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.467887 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.467742 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-workload-certs\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.467887 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.467761 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4hdv\" (UniqueName: \"kubernetes.io/projected/ac338bb6-d44c-4c72-81df-81214879277c-kube-api-access-s4hdv\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.467887 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.467784 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac338bb6-d44c-4c72-81df-81214879277c-istio-token\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.468027 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.467898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-istio-envoy\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.468027 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.467931 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-istio-data\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.468027 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.467947 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac338bb6-d44c-4c72-81df-81214879277c-istiod-ca-cert\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.468027 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.467976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-credential-socket\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.568648 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.568614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-workload-socket\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.568648 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.568650 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-workload-certs\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.568927 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.568670 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4hdv\" (UniqueName: \"kubernetes.io/projected/ac338bb6-d44c-4c72-81df-81214879277c-kube-api-access-s4hdv\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.568927 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.568687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac338bb6-d44c-4c72-81df-81214879277c-istio-token\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.568927 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.568763 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-istio-envoy\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.568927 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.568781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-istio-data\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.568927 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.568796 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac338bb6-d44c-4c72-81df-81214879277c-istiod-ca-cert\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.569211 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.569058 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-workload-socket\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.569211 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.569109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-credential-socket\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.569324 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.569216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac338bb6-d44c-4c72-81df-81214879277c-istio-podinfo\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.569324 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.569245 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-istio-data\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.569324 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.569259 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-workload-certs\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.569626 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.569597 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-credential-socket\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.569744 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.569646 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac338bb6-d44c-4c72-81df-81214879277c-istiod-ca-cert\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.571141 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.571120 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-istio-envoy\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.571592 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.571573 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac338bb6-d44c-4c72-81df-81214879277c-istio-podinfo\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.583400 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.583326 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac338bb6-d44c-4c72-81df-81214879277c-istio-token\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.583826 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.583809 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4hdv\" (UniqueName: \"kubernetes.io/projected/ac338bb6-d44c-4c72-81df-81214879277c-kube-api-access-s4hdv\") pod \"e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.642901 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.642869 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:09:59.799686 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.799658 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg"] Jul 24 15:09:59.800835 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:09:59.800810 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac338bb6_d44c_4c72_81df_81214879277c.slice/crio-78002c3d12a09c2d4b6b88e91d17eedb35eee84bfdf56b248e24415280ed2b59 WatchSource:0}: Error finding container 78002c3d12a09c2d4b6b88e91d17eedb35eee84bfdf56b248e24415280ed2b59: Status 404 returned error can't find the container with id 78002c3d12a09c2d4b6b88e91d17eedb35eee84bfdf56b248e24415280ed2b59 Jul 24 15:09:59.802977 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.802946 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:09:59.803040 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.803009 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:09:59.803077 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:09:59.803036 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:10:00.073116 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:00.073082 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" event={"ID":"ac338bb6-d44c-4c72-81df-81214879277c","Type":"ContainerStarted","Data":"0f012c54fdd1c2244eb20778cb943535c4497f473692464ea869b8810bc2c0bd"} Jul 24 15:10:00.073294 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:00.073142 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" event={"ID":"ac338bb6-d44c-4c72-81df-81214879277c","Type":"ContainerStarted","Data":"78002c3d12a09c2d4b6b88e91d17eedb35eee84bfdf56b248e24415280ed2b59"} Jul 24 15:10:00.102457 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:00.102348 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" podStartSLOduration=1.102331874 podStartE2EDuration="1.102331874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:09:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:10:00.099826167 +0000 UTC m=+2295.656742060" watchObservedRunningTime="2026-07-24 15:10:00.102331874 +0000 UTC m=+2295.659247766" Jul 24 15:10:00.644022 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:00.643984 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:10:00.648837 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:00.648810 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:10:01.079073 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:01.079041 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:10:01.079978 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:01.079956 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:10:03.250170 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:03.250127 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl"] Jul 24 15:10:03.250835 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:03.250794 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6663c7f-e06d-4647-928c-ca1e87fcf7a5" containerName="istio-proxy" Jul 24 15:10:03.250835 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:03.250838 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6663c7f-e06d-4647-928c-ca1e87fcf7a5" containerName="istio-proxy" Jul 24 15:10:03.250984 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:03.250943 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6663c7f-e06d-4647-928c-ca1e87fcf7a5" containerName="istio-proxy" Jul 24 15:10:03.254940 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:03.254911 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" Jul 24 15:10:03.261205 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:03.261167 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-b3c385\"" Jul 24 15:10:03.262066 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:03.262040 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-b3c385-dockercfg-8frpn\"" Jul 24 15:10:03.272083 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:03.272040 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl"] Jul 24 15:10:03.302970 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:03.302937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gp5x\" (UniqueName: \"kubernetes.io/projected/390481e3-c73c-4119-bd3b-7d731519f918-kube-api-access-7gp5x\") pod \"payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl\" (UID: \"390481e3-c73c-4119-bd3b-7d731519f918\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" Jul 24 15:10:03.303200 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:03.303165 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/390481e3-c73c-4119-bd3b-7d731519f918-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl\" (UID: \"390481e3-c73c-4119-bd3b-7d731519f918\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" Jul 24 15:10:03.404844 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:03.404809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gp5x\" (UniqueName: \"kubernetes.io/projected/390481e3-c73c-4119-bd3b-7d731519f918-kube-api-access-7gp5x\") pod \"payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl\" (UID: \"390481e3-c73c-4119-bd3b-7d731519f918\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" Jul 24 15:10:03.405043 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:03.404864 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/390481e3-c73c-4119-bd3b-7d731519f918-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl\" (UID: \"390481e3-c73c-4119-bd3b-7d731519f918\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" Jul 24 15:10:03.405873 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:03.405847 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/390481e3-c73c-4119-bd3b-7d731519f918-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl\" (UID: \"390481e3-c73c-4119-bd3b-7d731519f918\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" Jul 24 15:10:03.427051 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:03.427013 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gp5x\" (UniqueName: \"kubernetes.io/projected/390481e3-c73c-4119-bd3b-7d731519f918-kube-api-access-7gp5x\") pod \"payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl\" (UID: \"390481e3-c73c-4119-bd3b-7d731519f918\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" Jul 24 15:10:03.576144 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:03.576103 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" Jul 24 15:10:04.010007 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:04.009975 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl"] Jul 24 15:10:04.010277 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:10:04.010253 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod390481e3_c73c_4119_bd3b_7d731519f918.slice/crio-ab56898bed852431194a004b1c12271210a367c4369f5eb840d6610156735a48 WatchSource:0}: Error finding container ab56898bed852431194a004b1c12271210a367c4369f5eb840d6610156735a48: Status 404 returned error can't find the container with id ab56898bed852431194a004b1c12271210a367c4369f5eb840d6610156735a48 Jul 24 15:10:04.102178 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:04.102146 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" event={"ID":"390481e3-c73c-4119-bd3b-7d731519f918","Type":"ContainerStarted","Data":"ab56898bed852431194a004b1c12271210a367c4369f5eb840d6610156735a48"} Jul 24 15:10:05.108491 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:05.108445 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" event={"ID":"390481e3-c73c-4119-bd3b-7d731519f918","Type":"ContainerStarted","Data":"68e6a2ddb5ea25c0ef1041edfefee4f60d9b5445dd334b611d7f067b0ba5f32d"} Jul 24 15:10:05.108900 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:05.108600 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" Jul 24 15:10:05.128708 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:05.128664 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" podStartSLOduration=2.128646336 podStartE2EDuration="2.128646336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:10:05.127494 +0000 UTC m=+2300.684409892" watchObservedRunningTime="2026-07-24 15:10:05.128646336 +0000 UTC m=+2300.685562227" Jul 24 15:10:07.057736 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:07.057700 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" Jul 24 15:10:09.069748 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:09.069701 2581 patch_prober.go:28] interesting pod/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 24 15:10:09.070151 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:09.069775 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" podUID="2bfee445-195e-435a-9da3-8f150e051758" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 24 15:10:10.137973 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:10.137885 2581 generic.go:356] "Generic (PLEG): container finished" podID="2bfee445-195e-435a-9da3-8f150e051758" containerID="9f57cc28da98cb861bcb62a2a099ac572cf1f0fc4003f64932f83957172a03d3" exitCode=0 Jul 24 15:10:10.137973 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:10.137961 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" event={"ID":"2bfee445-195e-435a-9da3-8f150e051758","Type":"ContainerDied","Data":"9f57cc28da98cb861bcb62a2a099ac572cf1f0fc4003f64932f83957172a03d3"} Jul 24 15:10:10.138451 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:10.138422 2581 scope.go:117] "RemoveContainer" containerID="9f57cc28da98cb861bcb62a2a099ac572cf1f0fc4003f64932f83957172a03d3" Jul 24 15:10:10.139471 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:10.139444 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:10:10.139557 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:10.139513 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:10:10.139611 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:10.139568 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:10:11.145589 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:11.145548 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" event={"ID":"2bfee445-195e-435a-9da3-8f150e051758","Type":"ContainerStarted","Data":"db2673bb229f61927146d272c9f6f44774e289ec5be0c720c4dd9fb74cab1ee2"} Jul 24 15:10:11.618095 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:11.618055 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:10:11.618312 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:11.618272 2581 patch_prober.go:28] interesting pod/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 24 15:10:11.618390 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:11.618325 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" podUID="2bfee445-195e-435a-9da3-8f150e051758" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 24 15:10:12.618100 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:12.618068 2581 patch_prober.go:28] interesting pod/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 24 15:10:12.618506 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:12.618121 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" podUID="2bfee445-195e-435a-9da3-8f150e051758" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 24 15:10:13.618010 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:13.617971 2581 patch_prober.go:28] interesting pod/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 24 15:10:13.618201 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:13.618025 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" podUID="2bfee445-195e-435a-9da3-8f150e051758" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 24 15:10:14.617665 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:14.617624 2581 patch_prober.go:28] interesting pod/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 24 15:10:14.617860 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:14.617682 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" podUID="2bfee445-195e-435a-9da3-8f150e051758" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 24 15:10:15.621844 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:15.621814 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:10:15.622239 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:15.622070 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:10:15.622656 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:15.622635 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:10:16.117216 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:16.117186 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" Jul 24 15:10:20.207840 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:20.207802 2581 generic.go:356] "Generic (PLEG): container finished" podID="ac338bb6-d44c-4c72-81df-81214879277c" containerID="0f012c54fdd1c2244eb20778cb943535c4497f473692464ea869b8810bc2c0bd" exitCode=0 Jul 24 15:10:20.208335 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:20.207874 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" event={"ID":"ac338bb6-d44c-4c72-81df-81214879277c","Type":"ContainerDied","Data":"0f012c54fdd1c2244eb20778cb943535c4497f473692464ea869b8810bc2c0bd"} Jul 24 15:10:20.208335 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:20.208298 2581 scope.go:117] "RemoveContainer" containerID="0f012c54fdd1c2244eb20778cb943535c4497f473692464ea869b8810bc2c0bd" Jul 24 15:10:20.209252 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:20.209225 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:10:20.209345 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:20.209307 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:10:20.209345 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:20.209339 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:10:21.215524 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:21.215490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" event={"ID":"ac338bb6-d44c-4c72-81df-81214879277c","Type":"ContainerStarted","Data":"339bdb2ad91bc54f94b646ff24f1736cfecd212cbe8248e5140cddfbe1b615f1"} Jul 24 15:10:21.643326 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:21.643285 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:10:21.643566 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:21.643481 2581 patch_prober.go:28] interesting pod/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 24 15:10:21.643649 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:21.643563 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" podUID="ac338bb6-d44c-4c72-81df-81214879277c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 24 15:10:22.644304 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:22.644254 2581 patch_prober.go:28] interesting pod/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 24 15:10:22.644862 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:22.644326 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" podUID="ac338bb6-d44c-4c72-81df-81214879277c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 24 15:10:23.643431 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:23.643394 2581 patch_prober.go:28] interesting pod/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 24 15:10:23.643671 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:23.643465 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" podUID="ac338bb6-d44c-4c72-81df-81214879277c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 24 15:10:24.644566 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:24.644493 2581 patch_prober.go:28] interesting pod/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 24 15:10:24.645162 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:24.645130 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" podUID="ac338bb6-d44c-4c72-81df-81214879277c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 24 15:10:25.646775 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:25.646745 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:10:25.647188 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:25.647153 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:10:25.647947 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:25.647926 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:10:31.068613 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:31.068578 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb"] Jul 24 15:10:31.069166 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:31.068779 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" podUID="e8ad8792-5723-4c9a-ad19-1d44e6616e15" containerName="payload-processing" containerID="cri-o://be500d2d4b4f41c8b857d3ba5c096e57252872ac6fa247078992d1fa15bb64dc" gracePeriod=30 Jul 24 15:10:31.279783 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:31.279512 2581 generic.go:356] "Generic (PLEG): container finished" podID="e8ad8792-5723-4c9a-ad19-1d44e6616e15" containerID="be500d2d4b4f41c8b857d3ba5c096e57252872ac6fa247078992d1fa15bb64dc" exitCode=0 Jul 24 15:10:31.279783 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:31.279673 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" event={"ID":"e8ad8792-5723-4c9a-ad19-1d44e6616e15","Type":"ContainerDied","Data":"be500d2d4b4f41c8b857d3ba5c096e57252872ac6fa247078992d1fa15bb64dc"} Jul 24 15:10:31.348423 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:31.348392 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" Jul 24 15:10:31.384949 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:31.384921 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlmqw\" (UniqueName: \"kubernetes.io/projected/e8ad8792-5723-4c9a-ad19-1d44e6616e15-kube-api-access-mlmqw\") pod \"e8ad8792-5723-4c9a-ad19-1d44e6616e15\" (UID: \"e8ad8792-5723-4c9a-ad19-1d44e6616e15\") " Jul 24 15:10:31.385125 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:31.384986 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8ad8792-5723-4c9a-ad19-1d44e6616e15-plugins-config-volume\") pod \"e8ad8792-5723-4c9a-ad19-1d44e6616e15\" (UID: \"e8ad8792-5723-4c9a-ad19-1d44e6616e15\") " Jul 24 15:10:31.385470 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:31.385436 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8ad8792-5723-4c9a-ad19-1d44e6616e15-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e8ad8792-5723-4c9a-ad19-1d44e6616e15" (UID: "e8ad8792-5723-4c9a-ad19-1d44e6616e15"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:10:31.387116 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:31.387093 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ad8792-5723-4c9a-ad19-1d44e6616e15-kube-api-access-mlmqw" (OuterVolumeSpecName: "kube-api-access-mlmqw") pod "e8ad8792-5723-4c9a-ad19-1d44e6616e15" (UID: "e8ad8792-5723-4c9a-ad19-1d44e6616e15"). InnerVolumeSpecName "kube-api-access-mlmqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:10:31.486307 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:31.486276 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlmqw\" (UniqueName: \"kubernetes.io/projected/e8ad8792-5723-4c9a-ad19-1d44e6616e15-kube-api-access-mlmqw\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:10:31.486307 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:31.486301 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8ad8792-5723-4c9a-ad19-1d44e6616e15-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:10:32.287160 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:32.287132 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" Jul 24 15:10:32.287588 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:32.287168 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb" event={"ID":"e8ad8792-5723-4c9a-ad19-1d44e6616e15","Type":"ContainerDied","Data":"3ae09b92baf25403dd91faf4bc8a460cc27dcbb2411b9e9ba403362f722b41c4"} Jul 24 15:10:32.287588 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:32.287230 2581 scope.go:117] "RemoveContainer" containerID="be500d2d4b4f41c8b857d3ba5c096e57252872ac6fa247078992d1fa15bb64dc" Jul 24 15:10:32.310187 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:32.310159 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb"] Jul 24 15:10:32.313847 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:32.313824 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-b1e6f9-798bfcdbb-4m8vb"] Jul 24 15:10:32.972455 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:32.972410 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8ad8792-5723-4c9a-ad19-1d44e6616e15" path="/var/lib/kubelet/pods/e8ad8792-5723-4c9a-ad19-1d44e6616e15/volumes" Jul 24 15:10:42.862488 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:42.862406 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd"] Jul 24 15:10:42.862912 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:42.862723 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" podUID="2bfee445-195e-435a-9da3-8f150e051758" containerName="istio-proxy" containerID="cri-o://db2673bb229f61927146d272c9f6f44774e289ec5be0c720c4dd9fb74cab1ee2" gracePeriod=30 Jul 24 15:10:45.624230 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:45.624196 2581 patch_prober.go:28] interesting pod/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 15:10:45.624638 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:45.624250 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" podUID="2bfee445-195e-435a-9da3-8f150e051758" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 15:10:48.134707 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.134627 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:10:48.235808 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.235771 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-workload-socket\") pod \"2bfee445-195e-435a-9da3-8f150e051758\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " Jul 24 15:10:48.235983 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.235819 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-workload-certs\") pod \"2bfee445-195e-435a-9da3-8f150e051758\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " Jul 24 15:10:48.235983 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.235852 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bfee445-195e-435a-9da3-8f150e051758-istio-podinfo\") pod \"2bfee445-195e-435a-9da3-8f150e051758\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " Jul 24 15:10:48.235983 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.235875 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kscpk\" (UniqueName: \"kubernetes.io/projected/2bfee445-195e-435a-9da3-8f150e051758-kube-api-access-kscpk\") pod \"2bfee445-195e-435a-9da3-8f150e051758\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " Jul 24 15:10:48.235983 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.235911 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-credential-socket\") pod \"2bfee445-195e-435a-9da3-8f150e051758\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " Jul 24 15:10:48.235983 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.235929 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bfee445-195e-435a-9da3-8f150e051758-istio-token\") pod \"2bfee445-195e-435a-9da3-8f150e051758\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " Jul 24 15:10:48.235983 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.235962 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bfee445-195e-435a-9da3-8f150e051758-istiod-ca-cert\") pod \"2bfee445-195e-435a-9da3-8f150e051758\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " Jul 24 15:10:48.236336 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.235998 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-istio-envoy\") pod \"2bfee445-195e-435a-9da3-8f150e051758\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " Jul 24 15:10:48.236336 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.236067 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-istio-data\") pod \"2bfee445-195e-435a-9da3-8f150e051758\" (UID: \"2bfee445-195e-435a-9da3-8f150e051758\") " Jul 24 15:10:48.236336 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.236132 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2bfee445-195e-435a-9da3-8f150e051758" (UID: "2bfee445-195e-435a-9da3-8f150e051758"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:10:48.236336 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.236155 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2bfee445-195e-435a-9da3-8f150e051758" (UID: "2bfee445-195e-435a-9da3-8f150e051758"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:10:48.236586 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.236415 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-workload-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:10:48.236586 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.236437 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-workload-certs\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:10:48.236586 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.236492 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bfee445-195e-435a-9da3-8f150e051758-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2bfee445-195e-435a-9da3-8f150e051758" (UID: "2bfee445-195e-435a-9da3-8f150e051758"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:10:48.236749 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.236730 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2bfee445-195e-435a-9da3-8f150e051758" (UID: "2bfee445-195e-435a-9da3-8f150e051758"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:10:48.236955 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.236933 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-istio-data" (OuterVolumeSpecName: "istio-data") pod "2bfee445-195e-435a-9da3-8f150e051758" (UID: "2bfee445-195e-435a-9da3-8f150e051758"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:10:48.238167 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.238136 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2bfee445-195e-435a-9da3-8f150e051758-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2bfee445-195e-435a-9da3-8f150e051758" (UID: "2bfee445-195e-435a-9da3-8f150e051758"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 15:10:48.238336 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.238318 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2bfee445-195e-435a-9da3-8f150e051758" (UID: "2bfee445-195e-435a-9da3-8f150e051758"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:10:48.238655 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.238629 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bfee445-195e-435a-9da3-8f150e051758-istio-token" (OuterVolumeSpecName: "istio-token") pod "2bfee445-195e-435a-9da3-8f150e051758" (UID: "2bfee445-195e-435a-9da3-8f150e051758"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:10:48.238729 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.238643 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bfee445-195e-435a-9da3-8f150e051758-kube-api-access-kscpk" (OuterVolumeSpecName: "kube-api-access-kscpk") pod "2bfee445-195e-435a-9da3-8f150e051758" (UID: "2bfee445-195e-435a-9da3-8f150e051758"). InnerVolumeSpecName "kube-api-access-kscpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:10:48.337462 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.337428 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-istio-data\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:10:48.337462 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.337460 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bfee445-195e-435a-9da3-8f150e051758-istio-podinfo\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:10:48.337669 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.337473 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kscpk\" (UniqueName: \"kubernetes.io/projected/2bfee445-195e-435a-9da3-8f150e051758-kube-api-access-kscpk\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:10:48.337669 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.337488 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-credential-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:10:48.337669 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.337500 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bfee445-195e-435a-9da3-8f150e051758-istio-token\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:10:48.337669 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.337511 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bfee445-195e-435a-9da3-8f150e051758-istiod-ca-cert\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:10:48.337669 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.337521 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bfee445-195e-435a-9da3-8f150e051758-istio-envoy\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:10:48.376297 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.376260 2581 generic.go:356] "Generic (PLEG): container finished" podID="2bfee445-195e-435a-9da3-8f150e051758" containerID="db2673bb229f61927146d272c9f6f44774e289ec5be0c720c4dd9fb74cab1ee2" exitCode=0 Jul 24 15:10:48.376482 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.376310 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" Jul 24 15:10:48.376482 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.376340 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" event={"ID":"2bfee445-195e-435a-9da3-8f150e051758","Type":"ContainerDied","Data":"db2673bb229f61927146d272c9f6f44774e289ec5be0c720c4dd9fb74cab1ee2"} Jul 24 15:10:48.376482 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.376417 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd" event={"ID":"2bfee445-195e-435a-9da3-8f150e051758","Type":"ContainerDied","Data":"6291edd4cd6116686f845f1782c9dd1db5b799a8f2dd1b595e22afef03daf4df"} Jul 24 15:10:48.376482 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.376445 2581 scope.go:117] "RemoveContainer" containerID="db2673bb229f61927146d272c9f6f44774e289ec5be0c720c4dd9fb74cab1ee2" Jul 24 15:10:48.385566 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.385517 2581 scope.go:117] "RemoveContainer" containerID="9f57cc28da98cb861bcb62a2a099ac572cf1f0fc4003f64932f83957172a03d3" Jul 24 15:10:48.393711 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.393689 2581 scope.go:117] "RemoveContainer" containerID="db2673bb229f61927146d272c9f6f44774e289ec5be0c720c4dd9fb74cab1ee2" Jul 24 15:10:48.393994 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:10:48.393971 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db2673bb229f61927146d272c9f6f44774e289ec5be0c720c4dd9fb74cab1ee2\": container with ID starting with db2673bb229f61927146d272c9f6f44774e289ec5be0c720c4dd9fb74cab1ee2 not found: ID does not exist" containerID="db2673bb229f61927146d272c9f6f44774e289ec5be0c720c4dd9fb74cab1ee2" Jul 24 15:10:48.394084 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.394000 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db2673bb229f61927146d272c9f6f44774e289ec5be0c720c4dd9fb74cab1ee2"} err="failed to get container status \"db2673bb229f61927146d272c9f6f44774e289ec5be0c720c4dd9fb74cab1ee2\": rpc error: code = NotFound desc = could not find container \"db2673bb229f61927146d272c9f6f44774e289ec5be0c720c4dd9fb74cab1ee2\": container with ID starting with db2673bb229f61927146d272c9f6f44774e289ec5be0c720c4dd9fb74cab1ee2 not found: ID does not exist" Jul 24 15:10:48.394084 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.394019 2581 scope.go:117] "RemoveContainer" containerID="9f57cc28da98cb861bcb62a2a099ac572cf1f0fc4003f64932f83957172a03d3" Jul 24 15:10:48.394279 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:10:48.394262 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f57cc28da98cb861bcb62a2a099ac572cf1f0fc4003f64932f83957172a03d3\": container with ID starting with 9f57cc28da98cb861bcb62a2a099ac572cf1f0fc4003f64932f83957172a03d3 not found: ID does not exist" containerID="9f57cc28da98cb861bcb62a2a099ac572cf1f0fc4003f64932f83957172a03d3" Jul 24 15:10:48.394338 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.394289 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f57cc28da98cb861bcb62a2a099ac572cf1f0fc4003f64932f83957172a03d3"} err="failed to get container status \"9f57cc28da98cb861bcb62a2a099ac572cf1f0fc4003f64932f83957172a03d3\": rpc error: code = NotFound desc = could not find container \"9f57cc28da98cb861bcb62a2a099ac572cf1f0fc4003f64932f83957172a03d3\": container with ID starting with 9f57cc28da98cb861bcb62a2a099ac572cf1f0fc4003f64932f83957172a03d3 not found: ID does not exist" Jul 24 15:10:48.401833 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.401813 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd"] Jul 24 15:10:48.413108 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.413081 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b1e6f9-openshift-default-77b9cb7bf4-26rmd"] Jul 24 15:10:48.973203 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:48.973168 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bfee445-195e-435a-9da3-8f150e051758" path="/var/lib/kubelet/pods/2bfee445-195e-435a-9da3-8f150e051758/volumes" Jul 24 15:10:58.854999 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:58.854958 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl"] Jul 24 15:10:58.855488 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:58.855226 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" podUID="390481e3-c73c-4119-bd3b-7d731519f918" containerName="payload-pre-processing" containerID="cri-o://68e6a2ddb5ea25c0ef1041edfefee4f60d9b5445dd334b611d7f067b0ba5f32d" gracePeriod=30 Jul 24 15:10:59.128411 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:59.128386 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" Jul 24 15:10:59.238577 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:59.238515 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gp5x\" (UniqueName: \"kubernetes.io/projected/390481e3-c73c-4119-bd3b-7d731519f918-kube-api-access-7gp5x\") pod \"390481e3-c73c-4119-bd3b-7d731519f918\" (UID: \"390481e3-c73c-4119-bd3b-7d731519f918\") " Jul 24 15:10:59.238736 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:59.238675 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/390481e3-c73c-4119-bd3b-7d731519f918-plugins-config-volume\") pod \"390481e3-c73c-4119-bd3b-7d731519f918\" (UID: \"390481e3-c73c-4119-bd3b-7d731519f918\") " Jul 24 15:10:59.239083 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:59.239055 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/390481e3-c73c-4119-bd3b-7d731519f918-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "390481e3-c73c-4119-bd3b-7d731519f918" (UID: "390481e3-c73c-4119-bd3b-7d731519f918"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:10:59.240622 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:59.240597 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/390481e3-c73c-4119-bd3b-7d731519f918-kube-api-access-7gp5x" (OuterVolumeSpecName: "kube-api-access-7gp5x") pod "390481e3-c73c-4119-bd3b-7d731519f918" (UID: "390481e3-c73c-4119-bd3b-7d731519f918"). InnerVolumeSpecName "kube-api-access-7gp5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:10:59.339943 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:59.339904 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/390481e3-c73c-4119-bd3b-7d731519f918-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:10:59.339943 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:59.339936 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gp5x\" (UniqueName: \"kubernetes.io/projected/390481e3-c73c-4119-bd3b-7d731519f918-kube-api-access-7gp5x\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:10:59.432776 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:59.432679 2581 generic.go:356] "Generic (PLEG): container finished" podID="390481e3-c73c-4119-bd3b-7d731519f918" containerID="68e6a2ddb5ea25c0ef1041edfefee4f60d9b5445dd334b611d7f067b0ba5f32d" exitCode=0 Jul 24 15:10:59.432776 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:59.432736 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" Jul 24 15:10:59.432776 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:59.432767 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" event={"ID":"390481e3-c73c-4119-bd3b-7d731519f918","Type":"ContainerDied","Data":"68e6a2ddb5ea25c0ef1041edfefee4f60d9b5445dd334b611d7f067b0ba5f32d"} Jul 24 15:10:59.433048 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:59.432823 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl" event={"ID":"390481e3-c73c-4119-bd3b-7d731519f918","Type":"ContainerDied","Data":"ab56898bed852431194a004b1c12271210a367c4369f5eb840d6610156735a48"} Jul 24 15:10:59.433048 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:59.432845 2581 scope.go:117] "RemoveContainer" containerID="68e6a2ddb5ea25c0ef1041edfefee4f60d9b5445dd334b611d7f067b0ba5f32d" Jul 24 15:10:59.441954 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:59.441934 2581 scope.go:117] "RemoveContainer" containerID="68e6a2ddb5ea25c0ef1041edfefee4f60d9b5445dd334b611d7f067b0ba5f32d" Jul 24 15:10:59.442219 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:10:59.442201 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68e6a2ddb5ea25c0ef1041edfefee4f60d9b5445dd334b611d7f067b0ba5f32d\": container with ID starting with 68e6a2ddb5ea25c0ef1041edfefee4f60d9b5445dd334b611d7f067b0ba5f32d not found: ID does not exist" containerID="68e6a2ddb5ea25c0ef1041edfefee4f60d9b5445dd334b611d7f067b0ba5f32d" Jul 24 15:10:59.442285 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:59.442227 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68e6a2ddb5ea25c0ef1041edfefee4f60d9b5445dd334b611d7f067b0ba5f32d"} err="failed to get container status \"68e6a2ddb5ea25c0ef1041edfefee4f60d9b5445dd334b611d7f067b0ba5f32d\": rpc error: code = NotFound desc = could not find container \"68e6a2ddb5ea25c0ef1041edfefee4f60d9b5445dd334b611d7f067b0ba5f32d\": container with ID starting with 68e6a2ddb5ea25c0ef1041edfefee4f60d9b5445dd334b611d7f067b0ba5f32d not found: ID does not exist" Jul 24 15:10:59.458571 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:59.458518 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl"] Jul 24 15:10:59.465124 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:10:59.465093 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-b3c385-5f5c7b4664-6q2pl"] Jul 24 15:11:00.972280 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:00.972248 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="390481e3-c73c-4119-bd3b-7d731519f918" path="/var/lib/kubelet/pods/390481e3-c73c-4119-bd3b-7d731519f918/volumes" Jul 24 15:11:09.959257 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:09.959220 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg"] Jul 24 15:11:09.959877 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:09.959446 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" podUID="ac338bb6-d44c-4c72-81df-81214879277c" containerName="istio-proxy" containerID="cri-o://339bdb2ad91bc54f94b646ff24f1736cfecd212cbe8248e5140cddfbe1b615f1" gracePeriod=30 Jul 24 15:11:10.650469 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.650433 2581 patch_prober.go:28] interesting pod/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 15:11:10.650683 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.650499 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" podUID="ac338bb6-d44c-4c72-81df-81214879277c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 15:11:10.929903 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.929827 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt"] Jul 24 15:11:10.930216 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.930204 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bfee445-195e-435a-9da3-8f150e051758" containerName="istio-proxy" Jul 24 15:11:10.930263 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.930217 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bfee445-195e-435a-9da3-8f150e051758" containerName="istio-proxy" Jul 24 15:11:10.930263 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.930237 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="390481e3-c73c-4119-bd3b-7d731519f918" containerName="payload-pre-processing" Jul 24 15:11:10.930263 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.930243 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="390481e3-c73c-4119-bd3b-7d731519f918" containerName="payload-pre-processing" Jul 24 15:11:10.930263 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.930255 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bfee445-195e-435a-9da3-8f150e051758" containerName="istio-proxy" Jul 24 15:11:10.930263 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.930260 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bfee445-195e-435a-9da3-8f150e051758" containerName="istio-proxy" Jul 24 15:11:10.930425 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.930267 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8ad8792-5723-4c9a-ad19-1d44e6616e15" containerName="payload-processing" Jul 24 15:11:10.930425 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.930273 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8ad8792-5723-4c9a-ad19-1d44e6616e15" containerName="payload-processing" Jul 24 15:11:10.930425 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.930338 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bfee445-195e-435a-9da3-8f150e051758" containerName="istio-proxy" Jul 24 15:11:10.930425 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.930350 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="390481e3-c73c-4119-bd3b-7d731519f918" containerName="payload-pre-processing" Jul 24 15:11:10.930425 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.930357 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8ad8792-5723-4c9a-ad19-1d44e6616e15" containerName="payload-processing" Jul 24 15:11:10.934716 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.934696 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:10.937239 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.937217 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-dc7d81-openshift-default-dockercfg-nf4jx\"" Jul 24 15:11:10.949866 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:10.949840 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt"] Jul 24 15:11:11.050812 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.050774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82eae839-deca-4782-9a38-5a5d5062a379-istio-podinfo\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.051238 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.050822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-credential-socket\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.051238 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.050915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-istio-envoy\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.051238 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.050948 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rb97\" (UniqueName: \"kubernetes.io/projected/82eae839-deca-4782-9a38-5a5d5062a379-kube-api-access-9rb97\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.051238 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.050968 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82eae839-deca-4782-9a38-5a5d5062a379-istio-token\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.051238 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.051009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-workload-socket\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.051238 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.051097 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-workload-certs\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.051238 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.051126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-istio-data\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.051238 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.051202 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82eae839-deca-4782-9a38-5a5d5062a379-istiod-ca-cert\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.152235 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.152198 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-workload-certs\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.152235 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.152242 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-istio-data\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.152510 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.152288 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82eae839-deca-4782-9a38-5a5d5062a379-istiod-ca-cert\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.152510 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.152330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82eae839-deca-4782-9a38-5a5d5062a379-istio-podinfo\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.152510 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.152358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-credential-socket\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.152510 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.152397 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-istio-envoy\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.152510 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.152423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rb97\" (UniqueName: \"kubernetes.io/projected/82eae839-deca-4782-9a38-5a5d5062a379-kube-api-access-9rb97\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.152510 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.152450 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82eae839-deca-4782-9a38-5a5d5062a379-istio-token\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.152510 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.152485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-workload-socket\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.152909 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.152773 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-workload-certs\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.152909 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.152783 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-credential-socket\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.153091 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.153063 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-workload-socket\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.153230 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.153156 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-istio-data\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.153422 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.153402 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82eae839-deca-4782-9a38-5a5d5062a379-istiod-ca-cert\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.155293 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.155269 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-istio-envoy\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.155590 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.155568 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82eae839-deca-4782-9a38-5a5d5062a379-istio-podinfo\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.160958 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.160922 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rb97\" (UniqueName: \"kubernetes.io/projected/82eae839-deca-4782-9a38-5a5d5062a379-kube-api-access-9rb97\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.161173 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.161155 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82eae839-deca-4782-9a38-5a5d5062a379-istio-token\") pod \"e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.245711 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.245616 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:11.434439 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.434409 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt"] Jul 24 15:11:11.435287 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:11:11.435259 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82eae839_deca_4782_9a38_5a5d5062a379.slice/crio-14b384f67d00a2c5918ca775bcbc9a3f16e6476e2520ad95e1a6ce1948fa3728 WatchSource:0}: Error finding container 14b384f67d00a2c5918ca775bcbc9a3f16e6476e2520ad95e1a6ce1948fa3728: Status 404 returned error can't find the container with id 14b384f67d00a2c5918ca775bcbc9a3f16e6476e2520ad95e1a6ce1948fa3728 Jul 24 15:11:11.437608 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.437574 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:11:11.437707 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.437652 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:11:11.437707 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.437690 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:11:11.495762 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:11.495679 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" event={"ID":"82eae839-deca-4782-9a38-5a5d5062a379","Type":"ContainerStarted","Data":"14b384f67d00a2c5918ca775bcbc9a3f16e6476e2520ad95e1a6ce1948fa3728"} Jul 24 15:11:12.502765 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:12.502723 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" event={"ID":"82eae839-deca-4782-9a38-5a5d5062a379","Type":"ContainerStarted","Data":"af9404fbcd84afa0267327a28bfbb75898ce25c8241e1eeb68595391a598e151"} Jul 24 15:11:12.525156 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:12.525099 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" podStartSLOduration=2.525083596 podStartE2EDuration="2.525083596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:11:12.524463626 +0000 UTC m=+2368.081379519" watchObservedRunningTime="2026-07-24 15:11:12.525083596 +0000 UTC m=+2368.081999488" Jul 24 15:11:13.246712 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:13.246669 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:13.251794 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:13.251768 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:13.508070 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:13.507984 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:13.508872 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:13.508852 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:15.223404 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.223343 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:11:15.393783 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.393746 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-credential-socket\") pod \"ac338bb6-d44c-4c72-81df-81214879277c\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " Jul 24 15:11:15.393783 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.393780 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-istio-envoy\") pod \"ac338bb6-d44c-4c72-81df-81214879277c\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " Jul 24 15:11:15.393994 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.393826 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4hdv\" (UniqueName: \"kubernetes.io/projected/ac338bb6-d44c-4c72-81df-81214879277c-kube-api-access-s4hdv\") pod \"ac338bb6-d44c-4c72-81df-81214879277c\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " Jul 24 15:11:15.393994 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.393847 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-istio-data\") pod \"ac338bb6-d44c-4c72-81df-81214879277c\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " Jul 24 15:11:15.393994 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.393900 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac338bb6-d44c-4c72-81df-81214879277c-istio-podinfo\") pod \"ac338bb6-d44c-4c72-81df-81214879277c\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " Jul 24 15:11:15.393994 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.393925 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-workload-certs\") pod \"ac338bb6-d44c-4c72-81df-81214879277c\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " Jul 24 15:11:15.394206 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.394037 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac338bb6-d44c-4c72-81df-81214879277c-istiod-ca-cert\") pod \"ac338bb6-d44c-4c72-81df-81214879277c\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " Jul 24 15:11:15.394206 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.394041 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac338bb6-d44c-4c72-81df-81214879277c" (UID: "ac338bb6-d44c-4c72-81df-81214879277c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:11:15.394206 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.394067 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-workload-socket\") pod \"ac338bb6-d44c-4c72-81df-81214879277c\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " Jul 24 15:11:15.394206 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.394131 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac338bb6-d44c-4c72-81df-81214879277c-istio-token\") pod \"ac338bb6-d44c-4c72-81df-81214879277c\" (UID: \"ac338bb6-d44c-4c72-81df-81214879277c\") " Jul 24 15:11:15.394409 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.394273 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac338bb6-d44c-4c72-81df-81214879277c" (UID: "ac338bb6-d44c-4c72-81df-81214879277c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:11:15.394409 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.394360 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac338bb6-d44c-4c72-81df-81214879277c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac338bb6-d44c-4c72-81df-81214879277c" (UID: "ac338bb6-d44c-4c72-81df-81214879277c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:11:15.394409 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.394359 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac338bb6-d44c-4c72-81df-81214879277c" (UID: "ac338bb6-d44c-4c72-81df-81214879277c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:11:15.394551 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.394498 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac338bb6-d44c-4c72-81df-81214879277c-istiod-ca-cert\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:11:15.394551 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.394514 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-workload-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:11:15.394664 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.394557 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-credential-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:11:15.394664 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.394571 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-workload-certs\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:11:15.394664 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.394623 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac338bb6-d44c-4c72-81df-81214879277c" (UID: "ac338bb6-d44c-4c72-81df-81214879277c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:11:15.396266 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.396244 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac338bb6-d44c-4c72-81df-81214879277c-kube-api-access-s4hdv" (OuterVolumeSpecName: "kube-api-access-s4hdv") pod "ac338bb6-d44c-4c72-81df-81214879277c" (UID: "ac338bb6-d44c-4c72-81df-81214879277c"). InnerVolumeSpecName "kube-api-access-s4hdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:11:15.396266 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.396258 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac338bb6-d44c-4c72-81df-81214879277c-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac338bb6-d44c-4c72-81df-81214879277c" (UID: "ac338bb6-d44c-4c72-81df-81214879277c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:11:15.396498 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.396482 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac338bb6-d44c-4c72-81df-81214879277c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac338bb6-d44c-4c72-81df-81214879277c" (UID: "ac338bb6-d44c-4c72-81df-81214879277c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 15:11:15.396498 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.396489 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac338bb6-d44c-4c72-81df-81214879277c" (UID: "ac338bb6-d44c-4c72-81df-81214879277c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:11:15.495562 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.495451 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac338bb6-d44c-4c72-81df-81214879277c-istio-token\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:11:15.495562 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.495484 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-istio-envoy\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:11:15.495562 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.495495 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4hdv\" (UniqueName: \"kubernetes.io/projected/ac338bb6-d44c-4c72-81df-81214879277c-kube-api-access-s4hdv\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:11:15.495562 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.495504 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac338bb6-d44c-4c72-81df-81214879277c-istio-data\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:11:15.495562 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.495513 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac338bb6-d44c-4c72-81df-81214879277c-istio-podinfo\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:11:15.504006 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.503979 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs"] Jul 24 15:11:15.504363 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.504352 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac338bb6-d44c-4c72-81df-81214879277c" containerName="istio-proxy" Jul 24 15:11:15.504405 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.504366 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac338bb6-d44c-4c72-81df-81214879277c" containerName="istio-proxy" Jul 24 15:11:15.504405 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.504390 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac338bb6-d44c-4c72-81df-81214879277c" containerName="istio-proxy" Jul 24 15:11:15.504405 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.504395 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac338bb6-d44c-4c72-81df-81214879277c" containerName="istio-proxy" Jul 24 15:11:15.504498 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.504450 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac338bb6-d44c-4c72-81df-81214879277c" containerName="istio-proxy" Jul 24 15:11:15.504498 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.504458 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bfee445-195e-435a-9da3-8f150e051758" containerName="istio-proxy" Jul 24 15:11:15.507873 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.507856 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" Jul 24 15:11:15.520430 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.520405 2581 generic.go:356] "Generic (PLEG): container finished" podID="ac338bb6-d44c-4c72-81df-81214879277c" containerID="339bdb2ad91bc54f94b646ff24f1736cfecd212cbe8248e5140cddfbe1b615f1" exitCode=0 Jul 24 15:11:15.520560 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.520467 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" Jul 24 15:11:15.520560 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.520493 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" event={"ID":"ac338bb6-d44c-4c72-81df-81214879277c","Type":"ContainerDied","Data":"339bdb2ad91bc54f94b646ff24f1736cfecd212cbe8248e5140cddfbe1b615f1"} Jul 24 15:11:15.520684 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.520574 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg" event={"ID":"ac338bb6-d44c-4c72-81df-81214879277c","Type":"ContainerDied","Data":"78002c3d12a09c2d4b6b88e91d17eedb35eee84bfdf56b248e24415280ed2b59"} Jul 24 15:11:15.520684 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.520599 2581 scope.go:117] "RemoveContainer" containerID="339bdb2ad91bc54f94b646ff24f1736cfecd212cbe8248e5140cddfbe1b615f1" Jul 24 15:11:15.530311 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.530289 2581 scope.go:117] "RemoveContainer" containerID="0f012c54fdd1c2244eb20778cb943535c4497f473692464ea869b8810bc2c0bd" Jul 24 15:11:15.539048 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.539027 2581 scope.go:117] "RemoveContainer" containerID="339bdb2ad91bc54f94b646ff24f1736cfecd212cbe8248e5140cddfbe1b615f1" Jul 24 15:11:15.539974 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:11:15.539939 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"339bdb2ad91bc54f94b646ff24f1736cfecd212cbe8248e5140cddfbe1b615f1\": container with ID starting with 339bdb2ad91bc54f94b646ff24f1736cfecd212cbe8248e5140cddfbe1b615f1 not found: ID does not exist" containerID="339bdb2ad91bc54f94b646ff24f1736cfecd212cbe8248e5140cddfbe1b615f1" Jul 24 15:11:15.540112 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.539985 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339bdb2ad91bc54f94b646ff24f1736cfecd212cbe8248e5140cddfbe1b615f1"} err="failed to get container status \"339bdb2ad91bc54f94b646ff24f1736cfecd212cbe8248e5140cddfbe1b615f1\": rpc error: code = NotFound desc = could not find container \"339bdb2ad91bc54f94b646ff24f1736cfecd212cbe8248e5140cddfbe1b615f1\": container with ID starting with 339bdb2ad91bc54f94b646ff24f1736cfecd212cbe8248e5140cddfbe1b615f1 not found: ID does not exist" Jul 24 15:11:15.540112 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.540007 2581 scope.go:117] "RemoveContainer" containerID="0f012c54fdd1c2244eb20778cb943535c4497f473692464ea869b8810bc2c0bd" Jul 24 15:11:15.540355 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.540331 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-dc7d81\"" Jul 24 15:11:15.540496 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:11:15.540391 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f012c54fdd1c2244eb20778cb943535c4497f473692464ea869b8810bc2c0bd\": container with ID starting with 0f012c54fdd1c2244eb20778cb943535c4497f473692464ea869b8810bc2c0bd not found: ID does not exist" containerID="0f012c54fdd1c2244eb20778cb943535c4497f473692464ea869b8810bc2c0bd" Jul 24 15:11:15.540496 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.540421 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f012c54fdd1c2244eb20778cb943535c4497f473692464ea869b8810bc2c0bd"} err="failed to get container status \"0f012c54fdd1c2244eb20778cb943535c4497f473692464ea869b8810bc2c0bd\": rpc error: code = NotFound desc = could not find container \"0f012c54fdd1c2244eb20778cb943535c4497f473692464ea869b8810bc2c0bd\": container with ID starting with 0f012c54fdd1c2244eb20778cb943535c4497f473692464ea869b8810bc2c0bd not found: ID does not exist" Jul 24 15:11:15.542115 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.542097 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs"] Jul 24 15:11:15.586916 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.586885 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv"] Jul 24 15:11:15.587407 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.587392 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac338bb6-d44c-4c72-81df-81214879277c" containerName="istio-proxy" Jul 24 15:11:15.591643 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.591621 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" Jul 24 15:11:15.597360 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.597342 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-dc7d81-dockercfg-nkbbc\"" Jul 24 15:11:15.622366 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.622340 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv"] Jul 24 15:11:15.661049 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.661012 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg"] Jul 24 15:11:15.667252 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.667209 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-b3c385-openshift-default-796d49cf58-lcvkg"] Jul 24 15:11:15.697156 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.697118 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw9tw\" (UniqueName: \"kubernetes.io/projected/0b15d54e-bc08-42b7-9df3-427193ae03f9-kube-api-access-kw9tw\") pod \"payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv\" (UID: \"0b15d54e-bc08-42b7-9df3-427193ae03f9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" Jul 24 15:11:15.697327 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.697175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c97d7a5f-0bca-49c8-8caa-93ac2fe65f22-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs\" (UID: \"c97d7a5f-0bca-49c8-8caa-93ac2fe65f22\") " pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" Jul 24 15:11:15.697327 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.697227 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfhvv\" (UniqueName: \"kubernetes.io/projected/c97d7a5f-0bca-49c8-8caa-93ac2fe65f22-kube-api-access-vfhvv\") pod \"payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs\" (UID: \"c97d7a5f-0bca-49c8-8caa-93ac2fe65f22\") " pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" Jul 24 15:11:15.697406 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.697334 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b15d54e-bc08-42b7-9df3-427193ae03f9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv\" (UID: \"0b15d54e-bc08-42b7-9df3-427193ae03f9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" Jul 24 15:11:15.797820 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.797789 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfhvv\" (UniqueName: \"kubernetes.io/projected/c97d7a5f-0bca-49c8-8caa-93ac2fe65f22-kube-api-access-vfhvv\") pod \"payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs\" (UID: \"c97d7a5f-0bca-49c8-8caa-93ac2fe65f22\") " pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" Jul 24 15:11:15.798001 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.797856 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b15d54e-bc08-42b7-9df3-427193ae03f9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv\" (UID: \"0b15d54e-bc08-42b7-9df3-427193ae03f9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" Jul 24 15:11:15.798001 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.797898 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw9tw\" (UniqueName: \"kubernetes.io/projected/0b15d54e-bc08-42b7-9df3-427193ae03f9-kube-api-access-kw9tw\") pod \"payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv\" (UID: \"0b15d54e-bc08-42b7-9df3-427193ae03f9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" Jul 24 15:11:15.798001 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.797919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c97d7a5f-0bca-49c8-8caa-93ac2fe65f22-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs\" (UID: \"c97d7a5f-0bca-49c8-8caa-93ac2fe65f22\") " pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" Jul 24 15:11:15.798663 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.798643 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c97d7a5f-0bca-49c8-8caa-93ac2fe65f22-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs\" (UID: \"c97d7a5f-0bca-49c8-8caa-93ac2fe65f22\") " pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" Jul 24 15:11:15.798713 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.798669 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b15d54e-bc08-42b7-9df3-427193ae03f9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv\" (UID: \"0b15d54e-bc08-42b7-9df3-427193ae03f9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" Jul 24 15:11:15.806594 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.806568 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfhvv\" (UniqueName: \"kubernetes.io/projected/c97d7a5f-0bca-49c8-8caa-93ac2fe65f22-kube-api-access-vfhvv\") pod \"payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs\" (UID: \"c97d7a5f-0bca-49c8-8caa-93ac2fe65f22\") " pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" Jul 24 15:11:15.806697 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.806617 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw9tw\" (UniqueName: \"kubernetes.io/projected/0b15d54e-bc08-42b7-9df3-427193ae03f9-kube-api-access-kw9tw\") pod \"payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv\" (UID: \"0b15d54e-bc08-42b7-9df3-427193ae03f9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" Jul 24 15:11:15.818425 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.818403 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" Jul 24 15:11:15.904592 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.904557 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" Jul 24 15:11:15.968481 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:15.968433 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs"] Jul 24 15:11:16.066244 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:16.066207 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv"] Jul 24 15:11:16.067283 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:11:16.067260 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b15d54e_bc08_42b7_9df3_427193ae03f9.slice/crio-45365eb366b1da482760f9e4ab781741adadb66bb6eaafc2527b741e2e12fec0 WatchSource:0}: Error finding container 45365eb366b1da482760f9e4ab781741adadb66bb6eaafc2527b741e2e12fec0: Status 404 returned error can't find the container with id 45365eb366b1da482760f9e4ab781741adadb66bb6eaafc2527b741e2e12fec0 Jul 24 15:11:16.527130 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:16.527031 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" event={"ID":"0b15d54e-bc08-42b7-9df3-427193ae03f9","Type":"ContainerStarted","Data":"b5aa5a94bcb0841f9b90bc1da9b6e8dc045d7d2f99eadcc673b09a3f5c7a505d"} Jul 24 15:11:16.527130 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:16.527096 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" Jul 24 15:11:16.527130 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:16.527118 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" event={"ID":"0b15d54e-bc08-42b7-9df3-427193ae03f9","Type":"ContainerStarted","Data":"45365eb366b1da482760f9e4ab781741adadb66bb6eaafc2527b741e2e12fec0"} Jul 24 15:11:16.529504 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:16.529478 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" event={"ID":"c97d7a5f-0bca-49c8-8caa-93ac2fe65f22","Type":"ContainerStarted","Data":"abb2902aa182818341bd4d46f0d6fca6625b05e251073071234ec31bdbec7103"} Jul 24 15:11:16.529643 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:16.529544 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" event={"ID":"c97d7a5f-0bca-49c8-8caa-93ac2fe65f22","Type":"ContainerStarted","Data":"4e40dd26b888f729818bfb8d56bbaa24ed8826c10cdd4b1b7c7200487f73789e"} Jul 24 15:11:16.529643 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:16.529573 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" Jul 24 15:11:16.549382 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:16.549331 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" podStartSLOduration=1.549315583 podStartE2EDuration="1.549315583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:11:16.547036379 +0000 UTC m=+2372.103952273" watchObservedRunningTime="2026-07-24 15:11:16.549315583 +0000 UTC m=+2372.106231475" Jul 24 15:11:16.565523 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:16.565471 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" podStartSLOduration=1.565454934 podStartE2EDuration="1.565454934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:11:16.56309652 +0000 UTC m=+2372.120012411" watchObservedRunningTime="2026-07-24 15:11:16.565454934 +0000 UTC m=+2372.122370826" Jul 24 15:11:16.972571 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:16.972522 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac338bb6-d44c-4c72-81df-81214879277c" path="/var/lib/kubelet/pods/ac338bb6-d44c-4c72-81df-81214879277c/volumes" Jul 24 15:11:19.880660 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:19.880623 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4"] Jul 24 15:11:19.885380 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:19.885359 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:19.888637 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:19.888617 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-8ea489-openshift-default-dockercfg-5zdg6\"" Jul 24 15:11:19.895635 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:19.895610 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4"] Jul 24 15:11:19.933096 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:19.933063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-credential-socket\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:19.933336 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:19.933115 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-data\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:19.933336 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:19.933181 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-envoy\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:19.933336 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:19.933202 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-podinfo\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:19.933336 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:19.933254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-workload-socket\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:19.933336 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:19.933285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-workload-certs\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:19.933336 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:19.933303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv5f2\" (UniqueName: \"kubernetes.io/projected/b042dffc-7a94-4d39-afc1-51ca7fc870a8-kube-api-access-qv5f2\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:19.933336 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:19.933323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istiod-ca-cert\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:19.933741 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:19.933369 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-token\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.034234 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.034193 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-workload-socket\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.034234 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.034233 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-workload-certs\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.034511 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.034252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv5f2\" (UniqueName: \"kubernetes.io/projected/b042dffc-7a94-4d39-afc1-51ca7fc870a8-kube-api-access-qv5f2\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.034511 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.034292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istiod-ca-cert\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.034511 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.034349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-token\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.034511 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.034382 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-credential-socket\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.034511 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.034427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-data\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.034839 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.034584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-envoy\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.034839 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.034623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-podinfo\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.034839 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.034716 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-workload-socket\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.035122 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.035098 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-workload-certs\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.035122 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.035108 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istiod-ca-cert\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.035269 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.035231 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-credential-socket\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.035269 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.035256 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-data\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.036991 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.036964 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-envoy\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.037082 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.037055 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-podinfo\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.045368 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.045344 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-token\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.047378 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.047320 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv5f2\" (UniqueName: \"kubernetes.io/projected/b042dffc-7a94-4d39-afc1-51ca7fc870a8-kube-api-access-qv5f2\") pod \"e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.197021 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.196932 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:20.350996 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.350969 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4"] Jul 24 15:11:20.353636 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:11:20.353605 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb042dffc_7a94_4d39_afc1_51ca7fc870a8.slice/crio-fbe546c553ed01852159b61e33ce828cfa295721a51986fa24b15c6c108655c9 WatchSource:0}: Error finding container fbe546c553ed01852159b61e33ce828cfa295721a51986fa24b15c6c108655c9: Status 404 returned error can't find the container with id fbe546c553ed01852159b61e33ce828cfa295721a51986fa24b15c6c108655c9 Jul 24 15:11:20.356218 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.356183 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:11:20.356309 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.356250 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:11:20.356309 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.356278 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:11:20.554506 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.554467 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" event={"ID":"b042dffc-7a94-4d39-afc1-51ca7fc870a8","Type":"ContainerStarted","Data":"6c58ee6a35ae9f6b1fc5cbafa9dd507fe2d876e3acd72628f60faf45587c92ff"} Jul 24 15:11:20.554723 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.554523 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" event={"ID":"b042dffc-7a94-4d39-afc1-51ca7fc870a8","Type":"ContainerStarted","Data":"fbe546c553ed01852159b61e33ce828cfa295721a51986fa24b15c6c108655c9"} Jul 24 15:11:20.577076 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:20.577020 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" podStartSLOduration=1.5770038450000001 podStartE2EDuration="1.577003845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:11:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:11:20.574977137 +0000 UTC m=+2376.131893028" watchObservedRunningTime="2026-07-24 15:11:20.577003845 +0000 UTC m=+2376.133919786" Jul 24 15:11:21.197558 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:21.197490 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:21.203129 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:21.203102 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:21.560281 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:21.560250 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:21.561340 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:21.561320 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:27.537501 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:27.537465 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" Jul 24 15:11:27.537982 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:27.537586 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" Jul 24 15:11:29.549731 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:29.549682 2581 patch_prober.go:28] interesting pod/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 24 15:11:29.550170 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:29.549760 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" podUID="82eae839-deca-4782-9a38-5a5d5062a379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 24 15:11:31.623653 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:31.623616 2581 generic.go:356] "Generic (PLEG): container finished" podID="82eae839-deca-4782-9a38-5a5d5062a379" containerID="af9404fbcd84afa0267327a28bfbb75898ce25c8241e1eeb68595391a598e151" exitCode=0 Jul 24 15:11:31.624097 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:31.623691 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" event={"ID":"82eae839-deca-4782-9a38-5a5d5062a379","Type":"ContainerDied","Data":"af9404fbcd84afa0267327a28bfbb75898ce25c8241e1eeb68595391a598e151"} Jul 24 15:11:31.624185 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:31.624168 2581 scope.go:117] "RemoveContainer" containerID="af9404fbcd84afa0267327a28bfbb75898ce25c8241e1eeb68595391a598e151" Jul 24 15:11:31.625412 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:31.625381 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:11:31.625522 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:31.625456 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:11:31.625522 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:31.625494 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:11:32.631257 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:32.631217 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" event={"ID":"82eae839-deca-4782-9a38-5a5d5062a379","Type":"ContainerStarted","Data":"3ba53cd1a5379d8b3fe1ad5d9566e6392e143ec41fd5743a1b61bd2e8c1c036c"} Jul 24 15:11:33.250436 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:33.250397 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:33.261718 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:33.261662 2581 patch_prober.go:28] interesting pod/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Jul 24 15:11:33.261917 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:33.261750 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" podUID="82eae839-deca-4782-9a38-5a5d5062a379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Jul 24 15:11:34.246431 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:34.246391 2581 patch_prober.go:28] interesting pod/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Jul 24 15:11:34.247076 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:34.247041 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" podUID="82eae839-deca-4782-9a38-5a5d5062a379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Jul 24 15:11:35.246345 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:35.246303 2581 patch_prober.go:28] interesting pod/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Jul 24 15:11:35.246683 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:35.246651 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" podUID="82eae839-deca-4782-9a38-5a5d5062a379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Jul 24 15:11:36.247010 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:36.246971 2581 patch_prober.go:28] interesting pod/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Jul 24 15:11:36.247640 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:36.247605 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" podUID="82eae839-deca-4782-9a38-5a5d5062a379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Jul 24 15:11:37.256429 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:37.256389 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:37.257507 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:37.257443 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:37.262956 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:37.262933 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:11:40.689060 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:40.689024 2581 generic.go:356] "Generic (PLEG): container finished" podID="b042dffc-7a94-4d39-afc1-51ca7fc870a8" containerID="6c58ee6a35ae9f6b1fc5cbafa9dd507fe2d876e3acd72628f60faf45587c92ff" exitCode=0 Jul 24 15:11:40.689564 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:40.689070 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" event={"ID":"b042dffc-7a94-4d39-afc1-51ca7fc870a8","Type":"ContainerDied","Data":"6c58ee6a35ae9f6b1fc5cbafa9dd507fe2d876e3acd72628f60faf45587c92ff"} Jul 24 15:11:40.689564 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:40.689506 2581 scope.go:117] "RemoveContainer" containerID="6c58ee6a35ae9f6b1fc5cbafa9dd507fe2d876e3acd72628f60faf45587c92ff" Jul 24 15:11:40.690641 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:40.690617 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:11:40.690709 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:40.690687 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:11:40.690747 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:40.690724 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:11:41.697477 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:41.697440 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" event={"ID":"b042dffc-7a94-4d39-afc1-51ca7fc870a8","Type":"ContainerStarted","Data":"aa375f08d4a245b8edba9c942ed74e05d0fc5857a9588b74e49827e8023a25ca"} Jul 24 15:11:42.197516 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:42.197478 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:42.197743 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:42.197673 2581 patch_prober.go:28] interesting pod/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Jul 24 15:11:42.197743 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:42.197729 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" podUID="b042dffc-7a94-4d39-afc1-51ca7fc870a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Jul 24 15:11:43.197591 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:43.197500 2581 patch_prober.go:28] interesting pod/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Jul 24 15:11:43.198074 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:43.197615 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" podUID="b042dffc-7a94-4d39-afc1-51ca7fc870a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Jul 24 15:11:44.198137 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:44.198099 2581 patch_prober.go:28] interesting pod/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Jul 24 15:11:44.198564 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:44.198159 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" podUID="b042dffc-7a94-4d39-afc1-51ca7fc870a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Jul 24 15:11:45.100115 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:45.100082 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 15:11:45.107169 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:45.107141 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 15:11:45.107680 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:45.107659 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 15:11:45.114870 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:45.114853 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 15:11:45.197611 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:45.197580 2581 patch_prober.go:28] interesting pod/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Jul 24 15:11:45.197793 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:45.197639 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" podUID="b042dffc-7a94-4d39-afc1-51ca7fc870a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Jul 24 15:11:46.201709 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:46.201624 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:46.202160 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:46.202039 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:11:46.202655 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:11:46.202637 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:16:45.139141 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:16:45.139110 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 15:16:45.147925 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:16:45.147890 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 15:16:45.148129 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:16:45.148111 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 15:16:45.156295 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:16:45.156275 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 15:17:42.864023 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:42.863984 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh"] Jul 24 15:17:42.867841 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:42.867809 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" Jul 24 15:17:42.871258 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:42.871232 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-bb95eb-dockercfg-djpsn\"" Jul 24 15:17:42.871609 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:42.871592 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-bb95eb\"" Jul 24 15:17:42.882358 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:42.882329 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh"] Jul 24 15:17:42.899593 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:42.899557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d6380b7-baf7-415a-b2fa-8702aca6f61d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh\" (UID: \"5d6380b7-baf7-415a-b2fa-8702aca6f61d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" Jul 24 15:17:42.899731 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:42.899634 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj4nl\" (UniqueName: \"kubernetes.io/projected/5d6380b7-baf7-415a-b2fa-8702aca6f61d-kube-api-access-rj4nl\") pod \"payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh\" (UID: \"5d6380b7-baf7-415a-b2fa-8702aca6f61d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" Jul 24 15:17:43.000848 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:43.000808 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d6380b7-baf7-415a-b2fa-8702aca6f61d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh\" (UID: \"5d6380b7-baf7-415a-b2fa-8702aca6f61d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" Jul 24 15:17:43.001061 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:43.000870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj4nl\" (UniqueName: \"kubernetes.io/projected/5d6380b7-baf7-415a-b2fa-8702aca6f61d-kube-api-access-rj4nl\") pod \"payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh\" (UID: \"5d6380b7-baf7-415a-b2fa-8702aca6f61d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" Jul 24 15:17:43.001666 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:43.001641 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d6380b7-baf7-415a-b2fa-8702aca6f61d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh\" (UID: \"5d6380b7-baf7-415a-b2fa-8702aca6f61d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" Jul 24 15:17:43.009481 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:43.009452 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj4nl\" (UniqueName: \"kubernetes.io/projected/5d6380b7-baf7-415a-b2fa-8702aca6f61d-kube-api-access-rj4nl\") pod \"payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh\" (UID: \"5d6380b7-baf7-415a-b2fa-8702aca6f61d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" Jul 24 15:17:43.179647 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:43.179549 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" Jul 24 15:17:43.324541 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:43.324501 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh"] Jul 24 15:17:43.327841 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:17:43.327808 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6380b7_baf7_415a_b2fa_8702aca6f61d.slice/crio-7e14aa9d621b941d8227e58971bc0fdae8c3089dd20d618b6ae6147d256237de WatchSource:0}: Error finding container 7e14aa9d621b941d8227e58971bc0fdae8c3089dd20d618b6ae6147d256237de: Status 404 returned error can't find the container with id 7e14aa9d621b941d8227e58971bc0fdae8c3089dd20d618b6ae6147d256237de Jul 24 15:17:43.664619 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:43.664577 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" event={"ID":"5d6380b7-baf7-415a-b2fa-8702aca6f61d","Type":"ContainerStarted","Data":"13ae1d182a15d415ab8d70b97cfd8930c74b345d80d978e0411700fbf5eda2ad"} Jul 24 15:17:43.664841 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:43.664642 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" event={"ID":"5d6380b7-baf7-415a-b2fa-8702aca6f61d","Type":"ContainerStarted","Data":"7e14aa9d621b941d8227e58971bc0fdae8c3089dd20d618b6ae6147d256237de"} Jul 24 15:17:43.664841 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:43.664778 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" Jul 24 15:17:43.684661 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:43.684601 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" podStartSLOduration=1.684580726 podStartE2EDuration="1.684580726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:17:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:17:43.680769902 +0000 UTC m=+2759.237685794" watchObservedRunningTime="2026-07-24 15:17:43.684580726 +0000 UTC m=+2759.241496621" Jul 24 15:17:54.671722 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:54.671688 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" Jul 24 15:17:56.952971 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:56.952934 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p"] Jul 24 15:17:56.956648 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:56.956624 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:56.959907 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:56.959886 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-ba0783-openshift-default-dockercfg-qtxhh\"" Jul 24 15:17:56.982341 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:56.982300 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p"] Jul 24 15:17:57.037829 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.037790 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istiod-ca-cert\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.038015 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.037842 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dv98\" (UniqueName: \"kubernetes.io/projected/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-kube-api-access-5dv98\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.038015 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.037938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-workload-socket\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.038015 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.038008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-credential-socket\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.038146 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.038044 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-token\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.038146 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.038074 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-podinfo\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.038146 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.038102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-workload-certs\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.038259 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.038207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-envoy\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.038259 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.038240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-data\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.139260 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.139216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-envoy\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.139482 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.139277 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-data\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.139482 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.139339 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istiod-ca-cert\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.139482 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.139384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dv98\" (UniqueName: \"kubernetes.io/projected/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-kube-api-access-5dv98\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.139482 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.139417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-workload-socket\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.139482 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.139465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-credential-socket\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.139836 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.139498 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-token\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.139836 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.139559 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-podinfo\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.139836 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.139588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-workload-certs\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.139983 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.139856 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-data\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.140076 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.140055 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-workload-socket\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.140271 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.140248 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istiod-ca-cert\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.140354 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.140296 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-credential-socket\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.140354 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.140329 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-workload-certs\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.141806 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.141774 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-envoy\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.142126 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.142108 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-podinfo\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.150325 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.150298 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-token\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.150429 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.150361 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dv98\" (UniqueName: \"kubernetes.io/projected/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-kube-api-access-5dv98\") pod \"e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.267474 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.267393 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:57.424719 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.424690 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p"] Jul 24 15:17:57.426345 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:17:57.426317 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ffc064_cc1a_43e6_81cb_66c7fa91a9b1.slice/crio-a43c77ffeac93aae2a6aa2c626415408df804bbf129b4329494597631fde931b WatchSource:0}: Error finding container a43c77ffeac93aae2a6aa2c626415408df804bbf129b4329494597631fde931b: Status 404 returned error can't find the container with id a43c77ffeac93aae2a6aa2c626415408df804bbf129b4329494597631fde931b Jul 24 15:17:57.428722 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.428693 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:17:57.428820 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.428755 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:17:57.428820 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.428787 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:17:57.742725 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.742690 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" event={"ID":"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1","Type":"ContainerStarted","Data":"853e0cbdd69b87f7e6efeb7c0c7fba9be1dbf101b1d201d581611e8ae1d30479"} Jul 24 15:17:57.742941 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.742747 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" event={"ID":"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1","Type":"ContainerStarted","Data":"a43c77ffeac93aae2a6aa2c626415408df804bbf129b4329494597631fde931b"} Jul 24 15:17:57.768638 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:57.768582 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" podStartSLOduration=1.7685643 podStartE2EDuration="1.7685643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:17:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:17:57.766225044 +0000 UTC m=+2773.323140937" watchObservedRunningTime="2026-07-24 15:17:57.7685643 +0000 UTC m=+2773.325480191" Jul 24 15:17:58.268513 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:58.268466 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:58.273586 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:58.273560 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:58.749291 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:58.749260 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:17:58.750349 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:17:58.750330 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:18:02.090438 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.090401 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp"] Jul 24 15:18:02.094335 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.094317 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" Jul 24 15:18:02.096678 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.096652 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-ba0783-dockercfg-xd45l\"" Jul 24 15:18:02.096812 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.096652 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-ba0783\"" Jul 24 15:18:02.104389 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.104364 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp"] Jul 24 15:18:02.133378 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.133350 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7"] Jul 24 15:18:02.136850 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.136833 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" Jul 24 15:18:02.149379 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.149348 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7"] Jul 24 15:18:02.191062 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.191017 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghxxv\" (UniqueName: \"kubernetes.io/projected/a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2-kube-api-access-ghxxv\") pod \"payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp\" (UID: \"a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" Jul 24 15:18:02.191292 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.191090 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp\" (UID: \"a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" Jul 24 15:18:02.292888 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.292853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghxxv\" (UniqueName: \"kubernetes.io/projected/a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2-kube-api-access-ghxxv\") pod \"payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp\" (UID: \"a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" Jul 24 15:18:02.293068 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.292904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp\" (UID: \"a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" Jul 24 15:18:02.293068 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.292973 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa5569d7-c4b6-4295-b2dc-f04060a5e9dc-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7\" (UID: \"aa5569d7-c4b6-4295-b2dc-f04060a5e9dc\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" Jul 24 15:18:02.293068 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.293037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8xlx\" (UniqueName: \"kubernetes.io/projected/aa5569d7-c4b6-4295-b2dc-f04060a5e9dc-kube-api-access-s8xlx\") pod \"payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7\" (UID: \"aa5569d7-c4b6-4295-b2dc-f04060a5e9dc\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" Jul 24 15:18:02.293710 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.293690 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp\" (UID: \"a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" Jul 24 15:18:02.300977 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.300950 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghxxv\" (UniqueName: \"kubernetes.io/projected/a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2-kube-api-access-ghxxv\") pod \"payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp\" (UID: \"a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" Jul 24 15:18:02.394451 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.394350 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa5569d7-c4b6-4295-b2dc-f04060a5e9dc-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7\" (UID: \"aa5569d7-c4b6-4295-b2dc-f04060a5e9dc\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" Jul 24 15:18:02.394671 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.394501 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8xlx\" (UniqueName: \"kubernetes.io/projected/aa5569d7-c4b6-4295-b2dc-f04060a5e9dc-kube-api-access-s8xlx\") pod \"payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7\" (UID: \"aa5569d7-c4b6-4295-b2dc-f04060a5e9dc\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" Jul 24 15:18:02.395236 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.395215 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa5569d7-c4b6-4295-b2dc-f04060a5e9dc-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7\" (UID: \"aa5569d7-c4b6-4295-b2dc-f04060a5e9dc\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" Jul 24 15:18:02.405213 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.405184 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8xlx\" (UniqueName: \"kubernetes.io/projected/aa5569d7-c4b6-4295-b2dc-f04060a5e9dc-kube-api-access-s8xlx\") pod \"payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7\" (UID: \"aa5569d7-c4b6-4295-b2dc-f04060a5e9dc\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" Jul 24 15:18:02.406002 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.405983 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" Jul 24 15:18:02.449286 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.449243 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" Jul 24 15:18:02.567917 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.567884 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp"] Jul 24 15:18:02.569153 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:18:02.569124 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19ba95b_7bed_43b2_bbfb_5fd8d8cf11a2.slice/crio-745686285a44acfa69fc5ec6e3ce995a39577ebb726d6957cdfc9d52f4d32592 WatchSource:0}: Error finding container 745686285a44acfa69fc5ec6e3ce995a39577ebb726d6957cdfc9d52f4d32592: Status 404 returned error can't find the container with id 745686285a44acfa69fc5ec6e3ce995a39577ebb726d6957cdfc9d52f4d32592 Jul 24 15:18:02.782154 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.782122 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" event={"ID":"a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2","Type":"ContainerStarted","Data":"a70e69fe575f4225731dabf68dfd05d1dfde51a5b227932193c8888f459a11ed"} Jul 24 15:18:02.782337 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.782183 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" event={"ID":"a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2","Type":"ContainerStarted","Data":"745686285a44acfa69fc5ec6e3ce995a39577ebb726d6957cdfc9d52f4d32592"} Jul 24 15:18:02.782337 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.782213 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" Jul 24 15:18:02.819047 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.818997 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" podStartSLOduration=0.818978151 podStartE2EDuration="818.978151ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:18:02.817891912 +0000 UTC m=+2778.374807810" watchObservedRunningTime="2026-07-24 15:18:02.818978151 +0000 UTC m=+2778.375894043" Jul 24 15:18:02.852147 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:02.852103 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7"] Jul 24 15:18:02.852281 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:18:02.852131 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5569d7_c4b6_4295_b2dc_f04060a5e9dc.slice/crio-fdbb54b5da5ac7b84ab77bf73e55e5065b01c3ff3d3c656d525900c299193668 WatchSource:0}: Error finding container fdbb54b5da5ac7b84ab77bf73e55e5065b01c3ff3d3c656d525900c299193668: Status 404 returned error can't find the container with id fdbb54b5da5ac7b84ab77bf73e55e5065b01c3ff3d3c656d525900c299193668 Jul 24 15:18:03.789395 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:03.789358 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" event={"ID":"aa5569d7-c4b6-4295-b2dc-f04060a5e9dc","Type":"ContainerStarted","Data":"11d7a69031bc13fb39373286a9e4b95ca34ff95eff5f2739ccaddf7aad08dab0"} Jul 24 15:18:03.789882 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:03.789425 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" Jul 24 15:18:03.789882 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:03.789450 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" event={"ID":"aa5569d7-c4b6-4295-b2dc-f04060a5e9dc","Type":"ContainerStarted","Data":"fdbb54b5da5ac7b84ab77bf73e55e5065b01c3ff3d3c656d525900c299193668"} Jul 24 15:18:03.818045 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:03.817989 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" podStartSLOduration=1.817971452 podStartE2EDuration="1.817971452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:18:03.817547588 +0000 UTC m=+2779.374463471" watchObservedRunningTime="2026-07-24 15:18:03.817971452 +0000 UTC m=+2779.374887348" Jul 24 15:18:13.792297 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:13.792209 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" Jul 24 15:18:14.796678 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:14.796648 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" Jul 24 15:18:16.863522 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:16.863487 2581 generic.go:356] "Generic (PLEG): container finished" podID="71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" containerID="853e0cbdd69b87f7e6efeb7c0c7fba9be1dbf101b1d201d581611e8ae1d30479" exitCode=0 Jul 24 15:18:16.864051 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:16.863579 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" event={"ID":"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1","Type":"ContainerDied","Data":"853e0cbdd69b87f7e6efeb7c0c7fba9be1dbf101b1d201d581611e8ae1d30479"} Jul 24 15:18:16.864193 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:16.864175 2581 scope.go:117] "RemoveContainer" containerID="853e0cbdd69b87f7e6efeb7c0c7fba9be1dbf101b1d201d581611e8ae1d30479" Jul 24 15:18:16.865280 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:16.865252 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:18:16.865378 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:16.865336 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:18:16.865446 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:16.865381 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 24 15:18:17.874957 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:17.874921 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" event={"ID":"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1","Type":"ContainerStarted","Data":"26efe481d1edd4b53829743e615db3aee823965c34135475106e11096533af14"} Jul 24 15:18:18.268678 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:18.268574 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:18:18.268861 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:18.268704 2581 patch_prober.go:28] interesting pod/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Jul 24 15:18:18.268861 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:18.268829 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" podUID="71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Jul 24 15:18:19.268685 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:19.268644 2581 patch_prober.go:28] interesting pod/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Jul 24 15:18:19.269325 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:19.269287 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" podUID="71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Jul 24 15:18:20.268149 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:20.268100 2581 patch_prober.go:28] interesting pod/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Jul 24 15:18:20.268373 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:20.268172 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" podUID="71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Jul 24 15:18:21.268338 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:21.268300 2581 patch_prober.go:28] interesting pod/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Jul 24 15:18:21.268992 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:21.268948 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" podUID="71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Jul 24 15:18:22.271911 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:22.271881 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:18:22.272399 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:22.272163 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:18:22.272924 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:22.272906 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:18:26.574379 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:26.574349 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-4msfc_4b952219-50d1-4744-b6ce-d52d84e57c80/payload-processing/0.log" Jul 24 15:18:26.692270 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:18:26.692239 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7_aa5569d7-c4b6-4295-b2dc-f04060a5e9dc/payload-processing/0.log" Jul 24 15:19:14.336140 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:19:14.336106 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh_5d6380b7-baf7-415a-b2fa-8702aca6f61d/payload-processing/0.log" Jul 24 15:19:14.463611 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:19:14.463574 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-4msfc_4b952219-50d1-4744-b6ce-d52d84e57c80/payload-processing/0.log" Jul 24 15:19:14.583962 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:19:14.583927 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7_aa5569d7-c4b6-4295-b2dc-f04060a5e9dc/payload-processing/0.log" Jul 24 15:20:24.553446 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:24.553398 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh"] Jul 24 15:20:24.554103 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:24.553651 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" podUID="5d6380b7-baf7-415a-b2fa-8702aca6f61d" containerName="payload-processing" containerID="cri-o://13ae1d182a15d415ab8d70b97cfd8930c74b345d80d978e0411700fbf5eda2ad" gracePeriod=30 Jul 24 15:20:24.601018 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:20:24.600975 2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6380b7_baf7_415a_b2fa_8702aca6f61d.slice/crio-conmon-13ae1d182a15d415ab8d70b97cfd8930c74b345d80d978e0411700fbf5eda2ad.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6380b7_baf7_415a_b2fa_8702aca6f61d.slice/crio-13ae1d182a15d415ab8d70b97cfd8930c74b345d80d978e0411700fbf5eda2ad.scope\": RecentStats: unable to find data in memory cache]" Jul 24 15:20:24.671093 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:24.671047 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" podUID="5d6380b7-baf7-415a-b2fa-8702aca6f61d" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.77:9004: connect: connection refused" Jul 24 15:20:24.836157 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:24.836131 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" Jul 24 15:20:24.916737 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:24.916705 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d6380b7-baf7-415a-b2fa-8702aca6f61d-plugins-config-volume\") pod \"5d6380b7-baf7-415a-b2fa-8702aca6f61d\" (UID: \"5d6380b7-baf7-415a-b2fa-8702aca6f61d\") " Jul 24 15:20:24.916927 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:24.916808 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj4nl\" (UniqueName: \"kubernetes.io/projected/5d6380b7-baf7-415a-b2fa-8702aca6f61d-kube-api-access-rj4nl\") pod \"5d6380b7-baf7-415a-b2fa-8702aca6f61d\" (UID: \"5d6380b7-baf7-415a-b2fa-8702aca6f61d\") " Jul 24 15:20:24.917123 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:24.917092 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d6380b7-baf7-415a-b2fa-8702aca6f61d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5d6380b7-baf7-415a-b2fa-8702aca6f61d" (UID: "5d6380b7-baf7-415a-b2fa-8702aca6f61d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:20:24.919018 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:24.918995 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d6380b7-baf7-415a-b2fa-8702aca6f61d-kube-api-access-rj4nl" (OuterVolumeSpecName: "kube-api-access-rj4nl") pod "5d6380b7-baf7-415a-b2fa-8702aca6f61d" (UID: "5d6380b7-baf7-415a-b2fa-8702aca6f61d"). InnerVolumeSpecName "kube-api-access-rj4nl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:20:25.017750 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:25.017717 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj4nl\" (UniqueName: \"kubernetes.io/projected/5d6380b7-baf7-415a-b2fa-8702aca6f61d-kube-api-access-rj4nl\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:20:25.017750 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:25.017749 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d6380b7-baf7-415a-b2fa-8702aca6f61d-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:20:25.605460 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:25.605421 2581 generic.go:356] "Generic (PLEG): container finished" podID="5d6380b7-baf7-415a-b2fa-8702aca6f61d" containerID="13ae1d182a15d415ab8d70b97cfd8930c74b345d80d978e0411700fbf5eda2ad" exitCode=0 Jul 24 15:20:25.605460 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:25.605463 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" Jul 24 15:20:25.606051 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:25.605505 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" event={"ID":"5d6380b7-baf7-415a-b2fa-8702aca6f61d","Type":"ContainerDied","Data":"13ae1d182a15d415ab8d70b97cfd8930c74b345d80d978e0411700fbf5eda2ad"} Jul 24 15:20:25.606051 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:25.605572 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh" event={"ID":"5d6380b7-baf7-415a-b2fa-8702aca6f61d","Type":"ContainerDied","Data":"7e14aa9d621b941d8227e58971bc0fdae8c3089dd20d618b6ae6147d256237de"} Jul 24 15:20:25.606051 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:25.605598 2581 scope.go:117] "RemoveContainer" containerID="13ae1d182a15d415ab8d70b97cfd8930c74b345d80d978e0411700fbf5eda2ad" Jul 24 15:20:25.614727 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:25.614704 2581 scope.go:117] "RemoveContainer" containerID="13ae1d182a15d415ab8d70b97cfd8930c74b345d80d978e0411700fbf5eda2ad" Jul 24 15:20:25.614997 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:20:25.614975 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13ae1d182a15d415ab8d70b97cfd8930c74b345d80d978e0411700fbf5eda2ad\": container with ID starting with 13ae1d182a15d415ab8d70b97cfd8930c74b345d80d978e0411700fbf5eda2ad not found: ID does not exist" containerID="13ae1d182a15d415ab8d70b97cfd8930c74b345d80d978e0411700fbf5eda2ad" Jul 24 15:20:25.615057 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:25.614999 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13ae1d182a15d415ab8d70b97cfd8930c74b345d80d978e0411700fbf5eda2ad"} err="failed to get container status \"13ae1d182a15d415ab8d70b97cfd8930c74b345d80d978e0411700fbf5eda2ad\": rpc error: code = NotFound desc = could not find container \"13ae1d182a15d415ab8d70b97cfd8930c74b345d80d978e0411700fbf5eda2ad\": container with ID starting with 13ae1d182a15d415ab8d70b97cfd8930c74b345d80d978e0411700fbf5eda2ad not found: ID does not exist" Jul 24 15:20:25.622394 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:25.622359 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh"] Jul 24 15:20:25.626956 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:25.626929 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-bb95eb-64569d7844-t7zdh"] Jul 24 15:20:26.972601 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:20:26.972572 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d6380b7-baf7-415a-b2fa-8702aca6f61d" path="/var/lib/kubelet/pods/5d6380b7-baf7-415a-b2fa-8702aca6f61d/volumes" Jul 24 15:21:37.802539 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:37.802501 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7"] Jul 24 15:21:37.803215 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:37.802743 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" podUID="aa5569d7-c4b6-4295-b2dc-f04060a5e9dc" containerName="payload-processing" containerID="cri-o://11d7a69031bc13fb39373286a9e4b95ca34ff95eff5f2739ccaddf7aad08dab0" gracePeriod=30 Jul 24 15:21:37.817465 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:37.817430 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp"] Jul 24 15:21:37.817746 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:37.817691 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" podUID="a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2" containerName="payload-pre-processing" containerID="cri-o://a70e69fe575f4225731dabf68dfd05d1dfde51a5b227932193c8888f459a11ed" gracePeriod=30 Jul 24 15:21:38.023734 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.023634 2581 generic.go:356] "Generic (PLEG): container finished" podID="aa5569d7-c4b6-4295-b2dc-f04060a5e9dc" containerID="11d7a69031bc13fb39373286a9e4b95ca34ff95eff5f2739ccaddf7aad08dab0" exitCode=0 Jul 24 15:21:38.023918 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.023815 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" event={"ID":"aa5569d7-c4b6-4295-b2dc-f04060a5e9dc","Type":"ContainerDied","Data":"11d7a69031bc13fb39373286a9e4b95ca34ff95eff5f2739ccaddf7aad08dab0"} Jul 24 15:21:38.026146 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.026010 2581 generic.go:356] "Generic (PLEG): container finished" podID="a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2" containerID="a70e69fe575f4225731dabf68dfd05d1dfde51a5b227932193c8888f459a11ed" exitCode=0 Jul 24 15:21:38.026146 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.026072 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" event={"ID":"a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2","Type":"ContainerDied","Data":"a70e69fe575f4225731dabf68dfd05d1dfde51a5b227932193c8888f459a11ed"} Jul 24 15:21:38.094094 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.094068 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" Jul 24 15:21:38.112780 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.112749 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa5569d7-c4b6-4295-b2dc-f04060a5e9dc-plugins-config-volume\") pod \"aa5569d7-c4b6-4295-b2dc-f04060a5e9dc\" (UID: \"aa5569d7-c4b6-4295-b2dc-f04060a5e9dc\") " Jul 24 15:21:38.112910 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.112858 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8xlx\" (UniqueName: \"kubernetes.io/projected/aa5569d7-c4b6-4295-b2dc-f04060a5e9dc-kube-api-access-s8xlx\") pod \"aa5569d7-c4b6-4295-b2dc-f04060a5e9dc\" (UID: \"aa5569d7-c4b6-4295-b2dc-f04060a5e9dc\") " Jul 24 15:21:38.113239 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.113209 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa5569d7-c4b6-4295-b2dc-f04060a5e9dc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aa5569d7-c4b6-4295-b2dc-f04060a5e9dc" (UID: "aa5569d7-c4b6-4295-b2dc-f04060a5e9dc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:21:38.116174 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.116132 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa5569d7-c4b6-4295-b2dc-f04060a5e9dc-kube-api-access-s8xlx" (OuterVolumeSpecName: "kube-api-access-s8xlx") pod "aa5569d7-c4b6-4295-b2dc-f04060a5e9dc" (UID: "aa5569d7-c4b6-4295-b2dc-f04060a5e9dc"). InnerVolumeSpecName "kube-api-access-s8xlx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:21:38.126254 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.126228 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" Jul 24 15:21:38.213832 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.213796 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghxxv\" (UniqueName: \"kubernetes.io/projected/a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2-kube-api-access-ghxxv\") pod \"a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2\" (UID: \"a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2\") " Jul 24 15:21:38.214028 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.213933 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2-plugins-config-volume\") pod \"a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2\" (UID: \"a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2\") " Jul 24 15:21:38.214191 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.214175 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa5569d7-c4b6-4295-b2dc-f04060a5e9dc-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:38.214250 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.214196 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8xlx\" (UniqueName: \"kubernetes.io/projected/aa5569d7-c4b6-4295-b2dc-f04060a5e9dc-kube-api-access-s8xlx\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:38.214302 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.214261 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2" (UID: "a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:21:38.215856 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.215835 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2-kube-api-access-ghxxv" (OuterVolumeSpecName: "kube-api-access-ghxxv") pod "a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2" (UID: "a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2"). InnerVolumeSpecName "kube-api-access-ghxxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:21:38.315386 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.315347 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:38.315386 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:38.315375 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghxxv\" (UniqueName: \"kubernetes.io/projected/a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2-kube-api-access-ghxxv\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:39.032655 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:39.032618 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" Jul 24 15:21:39.033111 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:39.032658 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7" event={"ID":"aa5569d7-c4b6-4295-b2dc-f04060a5e9dc","Type":"ContainerDied","Data":"fdbb54b5da5ac7b84ab77bf73e55e5065b01c3ff3d3c656d525900c299193668"} Jul 24 15:21:39.033111 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:39.032739 2581 scope.go:117] "RemoveContainer" containerID="11d7a69031bc13fb39373286a9e4b95ca34ff95eff5f2739ccaddf7aad08dab0" Jul 24 15:21:39.042274 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:39.042248 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" Jul 24 15:21:39.042415 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:39.042248 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp" event={"ID":"a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2","Type":"ContainerDied","Data":"745686285a44acfa69fc5ec6e3ce995a39577ebb726d6957cdfc9d52f4d32592"} Jul 24 15:21:39.049814 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:39.049791 2581 scope.go:117] "RemoveContainer" containerID="a70e69fe575f4225731dabf68dfd05d1dfde51a5b227932193c8888f459a11ed" Jul 24 15:21:39.058750 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:39.058725 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7"] Jul 24 15:21:39.062168 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:39.062144 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-ba0783-555fcd986-4fpv7"] Jul 24 15:21:39.074984 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:39.074923 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp"] Jul 24 15:21:39.077110 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:39.077089 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-ba0783-747fb8645b-q8rqp"] Jul 24 15:21:40.974313 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:40.974283 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2" path="/var/lib/kubelet/pods/a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2/volumes" Jul 24 15:21:40.974712 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:40.974664 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa5569d7-c4b6-4295-b2dc-f04060a5e9dc" path="/var/lib/kubelet/pods/aa5569d7-c4b6-4295-b2dc-f04060a5e9dc/volumes" Jul 24 15:21:45.175876 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:45.175842 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 15:21:45.183295 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:45.183271 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 15:21:45.185214 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:45.185196 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 15:21:45.192512 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:45.192493 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5294p_28c3edc3-9454-48a6-b3fa-bcde5f0666f5/ovn-acl-logging/0.log" Jul 24 15:21:47.824960 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:47.824922 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p"] Jul 24 15:21:47.825827 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:47.825770 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" podUID="71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" containerName="istio-proxy" containerID="cri-o://26efe481d1edd4b53829743e615db3aee823965c34135475106e11096533af14" gracePeriod=30 Jul 24 15:21:52.274813 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:52.274774 2581 patch_prober.go:28] interesting pod/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 15:21:52.275201 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:52.274839 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" podUID="71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 15:21:53.094097 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.094037 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:21:53.130218 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.130181 2581 generic.go:356] "Generic (PLEG): container finished" podID="71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" containerID="26efe481d1edd4b53829743e615db3aee823965c34135475106e11096533af14" exitCode=0 Jul 24 15:21:53.130404 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.130229 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" event={"ID":"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1","Type":"ContainerDied","Data":"26efe481d1edd4b53829743e615db3aee823965c34135475106e11096533af14"} Jul 24 15:21:53.130404 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.130242 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" Jul 24 15:21:53.130404 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.130298 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p" event={"ID":"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1","Type":"ContainerDied","Data":"a43c77ffeac93aae2a6aa2c626415408df804bbf129b4329494597631fde931b"} Jul 24 15:21:53.130404 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.130324 2581 scope.go:117] "RemoveContainer" containerID="26efe481d1edd4b53829743e615db3aee823965c34135475106e11096533af14" Jul 24 15:21:53.139590 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.139569 2581 scope.go:117] "RemoveContainer" containerID="853e0cbdd69b87f7e6efeb7c0c7fba9be1dbf101b1d201d581611e8ae1d30479" Jul 24 15:21:53.148642 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.148619 2581 scope.go:117] "RemoveContainer" containerID="26efe481d1edd4b53829743e615db3aee823965c34135475106e11096533af14" Jul 24 15:21:53.148932 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:21:53.148913 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26efe481d1edd4b53829743e615db3aee823965c34135475106e11096533af14\": container with ID starting with 26efe481d1edd4b53829743e615db3aee823965c34135475106e11096533af14 not found: ID does not exist" containerID="26efe481d1edd4b53829743e615db3aee823965c34135475106e11096533af14" Jul 24 15:21:53.148986 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.148941 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26efe481d1edd4b53829743e615db3aee823965c34135475106e11096533af14"} err="failed to get container status \"26efe481d1edd4b53829743e615db3aee823965c34135475106e11096533af14\": rpc error: code = NotFound desc = could not find container \"26efe481d1edd4b53829743e615db3aee823965c34135475106e11096533af14\": container with ID starting with 26efe481d1edd4b53829743e615db3aee823965c34135475106e11096533af14 not found: ID does not exist" Jul 24 15:21:53.148986 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.148958 2581 scope.go:117] "RemoveContainer" containerID="853e0cbdd69b87f7e6efeb7c0c7fba9be1dbf101b1d201d581611e8ae1d30479" Jul 24 15:21:53.149232 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:21:53.149213 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"853e0cbdd69b87f7e6efeb7c0c7fba9be1dbf101b1d201d581611e8ae1d30479\": container with ID starting with 853e0cbdd69b87f7e6efeb7c0c7fba9be1dbf101b1d201d581611e8ae1d30479 not found: ID does not exist" containerID="853e0cbdd69b87f7e6efeb7c0c7fba9be1dbf101b1d201d581611e8ae1d30479" Jul 24 15:21:53.149278 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.149238 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"853e0cbdd69b87f7e6efeb7c0c7fba9be1dbf101b1d201d581611e8ae1d30479"} err="failed to get container status \"853e0cbdd69b87f7e6efeb7c0c7fba9be1dbf101b1d201d581611e8ae1d30479\": rpc error: code = NotFound desc = could not find container \"853e0cbdd69b87f7e6efeb7c0c7fba9be1dbf101b1d201d581611e8ae1d30479\": container with ID starting with 853e0cbdd69b87f7e6efeb7c0c7fba9be1dbf101b1d201d581611e8ae1d30479 not found: ID does not exist" Jul 24 15:21:53.162563 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.162514 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istiod-ca-cert\") pod \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " Jul 24 15:21:53.162657 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.162576 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-workload-socket\") pod \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " Jul 24 15:21:53.162657 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.162600 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-data\") pod \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " Jul 24 15:21:53.162657 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.162641 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-workload-certs\") pod \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " Jul 24 15:21:53.162805 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.162664 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-token\") pod \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " Jul 24 15:21:53.162805 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.162698 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dv98\" (UniqueName: \"kubernetes.io/projected/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-kube-api-access-5dv98\") pod \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " Jul 24 15:21:53.162805 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.162727 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-envoy\") pod \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " Jul 24 15:21:53.162805 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.162768 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-credential-socket\") pod \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " Jul 24 15:21:53.163022 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.162838 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-podinfo\") pod \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\" (UID: \"71ffc064-cc1a-43e6-81cb-66c7fa91a9b1\") " Jul 24 15:21:53.163022 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.162918 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" (UID: "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:21:53.163022 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.162933 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" (UID: "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:21:53.163022 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.162917 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" (UID: "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:21:53.163234 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.163178 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" (UID: "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:21:53.163295 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.163236 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istiod-ca-cert\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:53.163295 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.163256 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-workload-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:53.163295 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.163268 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-workload-certs\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:53.163471 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.163453 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-data" (OuterVolumeSpecName: "istio-data") pod "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" (UID: "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:21:53.165500 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.165476 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" (UID: "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 15:21:53.165615 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.165498 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-token" (OuterVolumeSpecName: "istio-token") pod "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" (UID: "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:21:53.165615 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.165512 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-kube-api-access-5dv98" (OuterVolumeSpecName: "kube-api-access-5dv98") pod "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" (UID: "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1"). InnerVolumeSpecName "kube-api-access-5dv98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:21:53.165615 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.165499 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" (UID: "71ffc064-cc1a-43e6-81cb-66c7fa91a9b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:21:53.264172 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.264136 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-podinfo\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:53.264172 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.264165 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-data\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:53.264172 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.264174 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-token\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:53.264406 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.264182 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dv98\" (UniqueName: \"kubernetes.io/projected/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-kube-api-access-5dv98\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:53.264406 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.264192 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-istio-envoy\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:53.264406 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.264201 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1-credential-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:53.455773 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.455739 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p"] Jul 24 15:21:53.459451 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:53.459425 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-ba0783-openshift-default-78dcf5dd7d-j992p"] Jul 24 15:21:54.972851 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:54.972808 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" path="/var/lib/kubelet/pods/71ffc064-cc1a-43e6-81cb-66c7fa91a9b1/volumes" Jul 24 15:21:58.776335 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:58.776302 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs"] Jul 24 15:21:58.776820 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:58.776605 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" podUID="c97d7a5f-0bca-49c8-8caa-93ac2fe65f22" containerName="payload-processing" containerID="cri-o://abb2902aa182818341bd4d46f0d6fca6625b05e251073071234ec31bdbec7103" gracePeriod=30 Jul 24 15:21:58.780730 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:58.780696 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv"] Jul 24 15:21:58.781982 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:58.781920 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" podUID="0b15d54e-bc08-42b7-9df3-427193ae03f9" containerName="payload-pre-processing" containerID="cri-o://b5aa5a94bcb0841f9b90bc1da9b6e8dc045d7d2f99eadcc673b09a3f5c7a505d" gracePeriod=30 Jul 24 15:21:59.054283 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.054258 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" Jul 24 15:21:59.085544 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.085509 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" Jul 24 15:21:59.164164 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.164129 2581 generic.go:356] "Generic (PLEG): container finished" podID="0b15d54e-bc08-42b7-9df3-427193ae03f9" containerID="b5aa5a94bcb0841f9b90bc1da9b6e8dc045d7d2f99eadcc673b09a3f5c7a505d" exitCode=0 Jul 24 15:21:59.164347 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.164169 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" Jul 24 15:21:59.164347 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.164164 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" event={"ID":"0b15d54e-bc08-42b7-9df3-427193ae03f9","Type":"ContainerDied","Data":"b5aa5a94bcb0841f9b90bc1da9b6e8dc045d7d2f99eadcc673b09a3f5c7a505d"} Jul 24 15:21:59.164347 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.164294 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv" event={"ID":"0b15d54e-bc08-42b7-9df3-427193ae03f9","Type":"ContainerDied","Data":"45365eb366b1da482760f9e4ab781741adadb66bb6eaafc2527b741e2e12fec0"} Jul 24 15:21:59.164347 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.164331 2581 scope.go:117] "RemoveContainer" containerID="b5aa5a94bcb0841f9b90bc1da9b6e8dc045d7d2f99eadcc673b09a3f5c7a505d" Jul 24 15:21:59.165519 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.165497 2581 generic.go:356] "Generic (PLEG): container finished" podID="c97d7a5f-0bca-49c8-8caa-93ac2fe65f22" containerID="abb2902aa182818341bd4d46f0d6fca6625b05e251073071234ec31bdbec7103" exitCode=0 Jul 24 15:21:59.165617 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.165559 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" event={"ID":"c97d7a5f-0bca-49c8-8caa-93ac2fe65f22","Type":"ContainerDied","Data":"abb2902aa182818341bd4d46f0d6fca6625b05e251073071234ec31bdbec7103"} Jul 24 15:21:59.165617 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.165570 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" Jul 24 15:21:59.165617 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.165593 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs" event={"ID":"c97d7a5f-0bca-49c8-8caa-93ac2fe65f22","Type":"ContainerDied","Data":"4e40dd26b888f729818bfb8d56bbaa24ed8826c10cdd4b1b7c7200487f73789e"} Jul 24 15:21:59.172943 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.172926 2581 scope.go:117] "RemoveContainer" containerID="b5aa5a94bcb0841f9b90bc1da9b6e8dc045d7d2f99eadcc673b09a3f5c7a505d" Jul 24 15:21:59.173192 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:21:59.173173 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5aa5a94bcb0841f9b90bc1da9b6e8dc045d7d2f99eadcc673b09a3f5c7a505d\": container with ID starting with b5aa5a94bcb0841f9b90bc1da9b6e8dc045d7d2f99eadcc673b09a3f5c7a505d not found: ID does not exist" containerID="b5aa5a94bcb0841f9b90bc1da9b6e8dc045d7d2f99eadcc673b09a3f5c7a505d" Jul 24 15:21:59.173261 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.173206 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5aa5a94bcb0841f9b90bc1da9b6e8dc045d7d2f99eadcc673b09a3f5c7a505d"} err="failed to get container status \"b5aa5a94bcb0841f9b90bc1da9b6e8dc045d7d2f99eadcc673b09a3f5c7a505d\": rpc error: code = NotFound desc = could not find container \"b5aa5a94bcb0841f9b90bc1da9b6e8dc045d7d2f99eadcc673b09a3f5c7a505d\": container with ID starting with b5aa5a94bcb0841f9b90bc1da9b6e8dc045d7d2f99eadcc673b09a3f5c7a505d not found: ID does not exist" Jul 24 15:21:59.173261 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.173231 2581 scope.go:117] "RemoveContainer" containerID="abb2902aa182818341bd4d46f0d6fca6625b05e251073071234ec31bdbec7103" Jul 24 15:21:59.180935 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.180920 2581 scope.go:117] "RemoveContainer" containerID="abb2902aa182818341bd4d46f0d6fca6625b05e251073071234ec31bdbec7103" Jul 24 15:21:59.181195 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:21:59.181174 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abb2902aa182818341bd4d46f0d6fca6625b05e251073071234ec31bdbec7103\": container with ID starting with abb2902aa182818341bd4d46f0d6fca6625b05e251073071234ec31bdbec7103 not found: ID does not exist" containerID="abb2902aa182818341bd4d46f0d6fca6625b05e251073071234ec31bdbec7103" Jul 24 15:21:59.181258 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.181204 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abb2902aa182818341bd4d46f0d6fca6625b05e251073071234ec31bdbec7103"} err="failed to get container status \"abb2902aa182818341bd4d46f0d6fca6625b05e251073071234ec31bdbec7103\": rpc error: code = NotFound desc = could not find container \"abb2902aa182818341bd4d46f0d6fca6625b05e251073071234ec31bdbec7103\": container with ID starting with abb2902aa182818341bd4d46f0d6fca6625b05e251073071234ec31bdbec7103 not found: ID does not exist" Jul 24 15:21:59.214538 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.214510 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw9tw\" (UniqueName: \"kubernetes.io/projected/0b15d54e-bc08-42b7-9df3-427193ae03f9-kube-api-access-kw9tw\") pod \"0b15d54e-bc08-42b7-9df3-427193ae03f9\" (UID: \"0b15d54e-bc08-42b7-9df3-427193ae03f9\") " Jul 24 15:21:59.214666 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.214580 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b15d54e-bc08-42b7-9df3-427193ae03f9-plugins-config-volume\") pod \"0b15d54e-bc08-42b7-9df3-427193ae03f9\" (UID: \"0b15d54e-bc08-42b7-9df3-427193ae03f9\") " Jul 24 15:21:59.214666 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.214645 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfhvv\" (UniqueName: \"kubernetes.io/projected/c97d7a5f-0bca-49c8-8caa-93ac2fe65f22-kube-api-access-vfhvv\") pod \"c97d7a5f-0bca-49c8-8caa-93ac2fe65f22\" (UID: \"c97d7a5f-0bca-49c8-8caa-93ac2fe65f22\") " Jul 24 15:21:59.214778 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.214700 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c97d7a5f-0bca-49c8-8caa-93ac2fe65f22-plugins-config-volume\") pod \"c97d7a5f-0bca-49c8-8caa-93ac2fe65f22\" (UID: \"c97d7a5f-0bca-49c8-8caa-93ac2fe65f22\") " Jul 24 15:21:59.214939 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.214916 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b15d54e-bc08-42b7-9df3-427193ae03f9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0b15d54e-bc08-42b7-9df3-427193ae03f9" (UID: "0b15d54e-bc08-42b7-9df3-427193ae03f9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:21:59.215020 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.215005 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b15d54e-bc08-42b7-9df3-427193ae03f9-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:59.215093 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.215069 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c97d7a5f-0bca-49c8-8caa-93ac2fe65f22-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c97d7a5f-0bca-49c8-8caa-93ac2fe65f22" (UID: "c97d7a5f-0bca-49c8-8caa-93ac2fe65f22"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:21:59.216574 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.216547 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c97d7a5f-0bca-49c8-8caa-93ac2fe65f22-kube-api-access-vfhvv" (OuterVolumeSpecName: "kube-api-access-vfhvv") pod "c97d7a5f-0bca-49c8-8caa-93ac2fe65f22" (UID: "c97d7a5f-0bca-49c8-8caa-93ac2fe65f22"). InnerVolumeSpecName "kube-api-access-vfhvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:21:59.216678 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.216596 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b15d54e-bc08-42b7-9df3-427193ae03f9-kube-api-access-kw9tw" (OuterVolumeSpecName: "kube-api-access-kw9tw") pod "0b15d54e-bc08-42b7-9df3-427193ae03f9" (UID: "0b15d54e-bc08-42b7-9df3-427193ae03f9"). InnerVolumeSpecName "kube-api-access-kw9tw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:21:59.316396 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.316306 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfhvv\" (UniqueName: \"kubernetes.io/projected/c97d7a5f-0bca-49c8-8caa-93ac2fe65f22-kube-api-access-vfhvv\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:59.316396 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.316352 2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c97d7a5f-0bca-49c8-8caa-93ac2fe65f22-plugins-config-volume\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:59.316396 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.316362 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw9tw\" (UniqueName: \"kubernetes.io/projected/0b15d54e-bc08-42b7-9df3-427193ae03f9-kube-api-access-kw9tw\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:21:59.487590 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.487564 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv"] Jul 24 15:21:59.491251 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.491225 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-dc7d81-55d9b65cdd-vjhkv"] Jul 24 15:21:59.502829 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.502807 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs"] Jul 24 15:21:59.514049 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:21:59.514013 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-dc7d81-846979485d-5lzhs"] Jul 24 15:22:00.973545 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:00.973486 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b15d54e-bc08-42b7-9df3-427193ae03f9" path="/var/lib/kubelet/pods/0b15d54e-bc08-42b7-9df3-427193ae03f9/volumes" Jul 24 15:22:00.974059 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:00.974036 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c97d7a5f-0bca-49c8-8caa-93ac2fe65f22" path="/var/lib/kubelet/pods/c97d7a5f-0bca-49c8-8caa-93ac2fe65f22/volumes" Jul 24 15:22:10.169630 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:10.169587 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt"] Jul 24 15:22:10.170258 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:10.169854 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" podUID="82eae839-deca-4782-9a38-5a5d5062a379" containerName="istio-proxy" containerID="cri-o://3ba53cd1a5379d8b3fe1ad5d9566e6392e143ec41fd5743a1b61bd2e8c1c036c" gracePeriod=30 Jul 24 15:22:15.432647 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.432589 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:22:15.471484 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.471456 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rb97\" (UniqueName: \"kubernetes.io/projected/82eae839-deca-4782-9a38-5a5d5062a379-kube-api-access-9rb97\") pod \"82eae839-deca-4782-9a38-5a5d5062a379\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " Jul 24 15:22:15.471484 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.471488 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82eae839-deca-4782-9a38-5a5d5062a379-istiod-ca-cert\") pod \"82eae839-deca-4782-9a38-5a5d5062a379\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " Jul 24 15:22:15.471762 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.471512 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-workload-socket\") pod \"82eae839-deca-4782-9a38-5a5d5062a379\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " Jul 24 15:22:15.471762 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.471566 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-istio-envoy\") pod \"82eae839-deca-4782-9a38-5a5d5062a379\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " Jul 24 15:22:15.471762 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.471591 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82eae839-deca-4782-9a38-5a5d5062a379-istio-podinfo\") pod \"82eae839-deca-4782-9a38-5a5d5062a379\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " Jul 24 15:22:15.471762 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.471612 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82eae839-deca-4782-9a38-5a5d5062a379-istio-token\") pod \"82eae839-deca-4782-9a38-5a5d5062a379\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " Jul 24 15:22:15.471762 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.471642 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-credential-socket\") pod \"82eae839-deca-4782-9a38-5a5d5062a379\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " Jul 24 15:22:15.471762 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.471664 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-istio-data\") pod \"82eae839-deca-4782-9a38-5a5d5062a379\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " Jul 24 15:22:15.472085 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.471851 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "82eae839-deca-4782-9a38-5a5d5062a379" (UID: "82eae839-deca-4782-9a38-5a5d5062a379"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:22:15.472085 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.471965 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "82eae839-deca-4782-9a38-5a5d5062a379" (UID: "82eae839-deca-4782-9a38-5a5d5062a379"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:22:15.472085 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.471980 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82eae839-deca-4782-9a38-5a5d5062a379-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "82eae839-deca-4782-9a38-5a5d5062a379" (UID: "82eae839-deca-4782-9a38-5a5d5062a379"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:22:15.472259 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.472118 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-workload-certs\") pod \"82eae839-deca-4782-9a38-5a5d5062a379\" (UID: \"82eae839-deca-4782-9a38-5a5d5062a379\") " Jul 24 15:22:15.472356 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.472335 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "82eae839-deca-4782-9a38-5a5d5062a379" (UID: "82eae839-deca-4782-9a38-5a5d5062a379"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:22:15.472465 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.472446 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-credential-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:15.472465 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.472465 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-workload-certs\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:15.472695 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.472478 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82eae839-deca-4782-9a38-5a5d5062a379-istiod-ca-cert\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:15.472695 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.472491 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-workload-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:15.472901 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.472877 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-istio-data" (OuterVolumeSpecName: "istio-data") pod "82eae839-deca-4782-9a38-5a5d5062a379" (UID: "82eae839-deca-4782-9a38-5a5d5062a379"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:22:15.474024 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.473996 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/82eae839-deca-4782-9a38-5a5d5062a379-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "82eae839-deca-4782-9a38-5a5d5062a379" (UID: "82eae839-deca-4782-9a38-5a5d5062a379"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 15:22:15.474243 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.474214 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82eae839-deca-4782-9a38-5a5d5062a379-kube-api-access-9rb97" (OuterVolumeSpecName: "kube-api-access-9rb97") pod "82eae839-deca-4782-9a38-5a5d5062a379" (UID: "82eae839-deca-4782-9a38-5a5d5062a379"). InnerVolumeSpecName "kube-api-access-9rb97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:22:15.474353 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.474319 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "82eae839-deca-4782-9a38-5a5d5062a379" (UID: "82eae839-deca-4782-9a38-5a5d5062a379"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:22:15.474685 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.474660 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82eae839-deca-4782-9a38-5a5d5062a379-istio-token" (OuterVolumeSpecName: "istio-token") pod "82eae839-deca-4782-9a38-5a5d5062a379" (UID: "82eae839-deca-4782-9a38-5a5d5062a379"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:22:15.572923 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.572883 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-istio-envoy\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:15.572923 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.572913 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82eae839-deca-4782-9a38-5a5d5062a379-istio-podinfo\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:15.572923 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.572926 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82eae839-deca-4782-9a38-5a5d5062a379-istio-token\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:15.573170 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.572935 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82eae839-deca-4782-9a38-5a5d5062a379-istio-data\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:15.573170 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:15.572947 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rb97\" (UniqueName: \"kubernetes.io/projected/82eae839-deca-4782-9a38-5a5d5062a379-kube-api-access-9rb97\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:16.263402 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:16.263359 2581 generic.go:356] "Generic (PLEG): container finished" podID="82eae839-deca-4782-9a38-5a5d5062a379" containerID="3ba53cd1a5379d8b3fe1ad5d9566e6392e143ec41fd5743a1b61bd2e8c1c036c" exitCode=0 Jul 24 15:22:16.263641 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:16.263416 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" Jul 24 15:22:16.263766 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:16.263734 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" event={"ID":"82eae839-deca-4782-9a38-5a5d5062a379","Type":"ContainerDied","Data":"3ba53cd1a5379d8b3fe1ad5d9566e6392e143ec41fd5743a1b61bd2e8c1c036c"} Jul 24 15:22:16.263883 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:16.263808 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt" event={"ID":"82eae839-deca-4782-9a38-5a5d5062a379","Type":"ContainerDied","Data":"14b384f67d00a2c5918ca775bcbc9a3f16e6476e2520ad95e1a6ce1948fa3728"} Jul 24 15:22:16.263883 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:16.263845 2581 scope.go:117] "RemoveContainer" containerID="3ba53cd1a5379d8b3fe1ad5d9566e6392e143ec41fd5743a1b61bd2e8c1c036c" Jul 24 15:22:16.273096 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:16.273078 2581 scope.go:117] "RemoveContainer" containerID="af9404fbcd84afa0267327a28bfbb75898ce25c8241e1eeb68595391a598e151" Jul 24 15:22:16.281049 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:16.281034 2581 scope.go:117] "RemoveContainer" containerID="3ba53cd1a5379d8b3fe1ad5d9566e6392e143ec41fd5743a1b61bd2e8c1c036c" Jul 24 15:22:16.281293 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:22:16.281278 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ba53cd1a5379d8b3fe1ad5d9566e6392e143ec41fd5743a1b61bd2e8c1c036c\": container with ID starting with 3ba53cd1a5379d8b3fe1ad5d9566e6392e143ec41fd5743a1b61bd2e8c1c036c not found: ID does not exist" containerID="3ba53cd1a5379d8b3fe1ad5d9566e6392e143ec41fd5743a1b61bd2e8c1c036c" Jul 24 15:22:16.281347 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:16.281300 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba53cd1a5379d8b3fe1ad5d9566e6392e143ec41fd5743a1b61bd2e8c1c036c"} err="failed to get container status \"3ba53cd1a5379d8b3fe1ad5d9566e6392e143ec41fd5743a1b61bd2e8c1c036c\": rpc error: code = NotFound desc = could not find container \"3ba53cd1a5379d8b3fe1ad5d9566e6392e143ec41fd5743a1b61bd2e8c1c036c\": container with ID starting with 3ba53cd1a5379d8b3fe1ad5d9566e6392e143ec41fd5743a1b61bd2e8c1c036c not found: ID does not exist" Jul 24 15:22:16.281347 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:16.281316 2581 scope.go:117] "RemoveContainer" containerID="af9404fbcd84afa0267327a28bfbb75898ce25c8241e1eeb68595391a598e151" Jul 24 15:22:16.281629 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:22:16.281518 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af9404fbcd84afa0267327a28bfbb75898ce25c8241e1eeb68595391a598e151\": container with ID starting with af9404fbcd84afa0267327a28bfbb75898ce25c8241e1eeb68595391a598e151 not found: ID does not exist" containerID="af9404fbcd84afa0267327a28bfbb75898ce25c8241e1eeb68595391a598e151" Jul 24 15:22:16.281703 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:16.281641 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af9404fbcd84afa0267327a28bfbb75898ce25c8241e1eeb68595391a598e151"} err="failed to get container status \"af9404fbcd84afa0267327a28bfbb75898ce25c8241e1eeb68595391a598e151\": rpc error: code = NotFound desc = could not find container \"af9404fbcd84afa0267327a28bfbb75898ce25c8241e1eeb68595391a598e151\": container with ID starting with af9404fbcd84afa0267327a28bfbb75898ce25c8241e1eeb68595391a598e151 not found: ID does not exist" Jul 24 15:22:16.285980 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:16.285957 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt"] Jul 24 15:22:16.291168 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:16.291148 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-dc7d81-openshift-default-69d8dc9c68-sxjlt"] Jul 24 15:22:16.972841 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:16.972812 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82eae839-deca-4782-9a38-5a5d5062a379" path="/var/lib/kubelet/pods/82eae839-deca-4782-9a38-5a5d5062a379/volumes" Jul 24 15:22:32.145020 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:32.144986 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4"] Jul 24 15:22:32.145479 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:32.145228 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" podUID="b042dffc-7a94-4d39-afc1-51ca7fc870a8" containerName="istio-proxy" containerID="cri-o://aa375f08d4a245b8edba9c942ed74e05d0fc5857a9588b74e49827e8023a25ca" gracePeriod=30 Jul 24 15:22:32.778966 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:32.778924 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f4f559458-cbpbh_f3723dc8-d99f-40f3-93e4-b46ff24c37e3/authorino/0.log" Jul 24 15:22:37.384125 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.384092 2581 generic.go:356] "Generic (PLEG): container finished" podID="b042dffc-7a94-4d39-afc1-51ca7fc870a8" containerID="aa375f08d4a245b8edba9c942ed74e05d0fc5857a9588b74e49827e8023a25ca" exitCode=0 Jul 24 15:22:37.384465 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.384152 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" event={"ID":"b042dffc-7a94-4d39-afc1-51ca7fc870a8","Type":"ContainerDied","Data":"aa375f08d4a245b8edba9c942ed74e05d0fc5857a9588b74e49827e8023a25ca"} Jul 24 15:22:37.384465 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.384216 2581 scope.go:117] "RemoveContainer" containerID="6c58ee6a35ae9f6b1fc5cbafa9dd507fe2d876e3acd72628f60faf45587c92ff" Jul 24 15:22:37.406737 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.406717 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:22:37.484229 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.484144 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-podinfo\") pod \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " Jul 24 15:22:37.484229 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.484185 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-workload-socket\") pod \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " Jul 24 15:22:37.484467 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.484321 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-data\") pod \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " Jul 24 15:22:37.484467 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.484383 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-token\") pod \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " Jul 24 15:22:37.484467 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.484420 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istiod-ca-cert\") pod \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " Jul 24 15:22:37.484467 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.484446 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-envoy\") pod \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " Jul 24 15:22:37.484724 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.484506 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-workload-certs\") pod \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " Jul 24 15:22:37.484724 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.484562 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b042dffc-7a94-4d39-afc1-51ca7fc870a8" (UID: "b042dffc-7a94-4d39-afc1-51ca7fc870a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:22:37.484724 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.484568 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv5f2\" (UniqueName: \"kubernetes.io/projected/b042dffc-7a94-4d39-afc1-51ca7fc870a8-kube-api-access-qv5f2\") pod \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " Jul 24 15:22:37.484724 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.484648 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-credential-socket\") pod \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\" (UID: \"b042dffc-7a94-4d39-afc1-51ca7fc870a8\") " Jul 24 15:22:37.484935 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.484873 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b042dffc-7a94-4d39-afc1-51ca7fc870a8" (UID: "b042dffc-7a94-4d39-afc1-51ca7fc870a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:22:37.485100 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.485060 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "b042dffc-7a94-4d39-afc1-51ca7fc870a8" (UID: "b042dffc-7a94-4d39-afc1-51ca7fc870a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:22:37.485100 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.485081 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b042dffc-7a94-4d39-afc1-51ca7fc870a8" (UID: "b042dffc-7a94-4d39-afc1-51ca7fc870a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:22:37.485239 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.485124 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-workload-certs\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:37.485239 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.485136 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b042dffc-7a94-4d39-afc1-51ca7fc870a8" (UID: "b042dffc-7a94-4d39-afc1-51ca7fc870a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:22:37.485239 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.485147 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-workload-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:37.486685 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.486653 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b042dffc-7a94-4d39-afc1-51ca7fc870a8" (UID: "b042dffc-7a94-4d39-afc1-51ca7fc870a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:22:37.486819 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.486691 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b042dffc-7a94-4d39-afc1-51ca7fc870a8" (UID: "b042dffc-7a94-4d39-afc1-51ca7fc870a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 15:22:37.486924 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.486902 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b042dffc-7a94-4d39-afc1-51ca7fc870a8-kube-api-access-qv5f2" (OuterVolumeSpecName: "kube-api-access-qv5f2") pod "b042dffc-7a94-4d39-afc1-51ca7fc870a8" (UID: "b042dffc-7a94-4d39-afc1-51ca7fc870a8"). InnerVolumeSpecName "kube-api-access-qv5f2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:22:37.486984 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.486945 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "b042dffc-7a94-4d39-afc1-51ca7fc870a8" (UID: "b042dffc-7a94-4d39-afc1-51ca7fc870a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:22:37.586671 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.586636 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-data\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:37.586671 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.586664 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-token\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:37.586671 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.586674 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istiod-ca-cert\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:37.586918 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.586682 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-envoy\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:37.586918 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.586690 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv5f2\" (UniqueName: \"kubernetes.io/projected/b042dffc-7a94-4d39-afc1-51ca7fc870a8-kube-api-access-qv5f2\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:37.586918 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.586699 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b042dffc-7a94-4d39-afc1-51ca7fc870a8-credential-socket\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:37.586918 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:37.586706 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b042dffc-7a94-4d39-afc1-51ca7fc870a8-istio-podinfo\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:22:38.391419 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:38.391389 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" Jul 24 15:22:38.391933 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:38.391431 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4" event={"ID":"b042dffc-7a94-4d39-afc1-51ca7fc870a8","Type":"ContainerDied","Data":"fbe546c553ed01852159b61e33ce828cfa295721a51986fa24b15c6c108655c9"} Jul 24 15:22:38.391933 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:38.391489 2581 scope.go:117] "RemoveContainer" containerID="aa375f08d4a245b8edba9c942ed74e05d0fc5857a9588b74e49827e8023a25ca" Jul 24 15:22:38.426754 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:38.426725 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4"] Jul 24 15:22:38.431201 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:38.431178 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-8ea489-openshift-default-7f6598cdb8-8bpn4"] Jul 24 15:22:38.469135 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:38.469113 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-j447f_90c483e5-7333-4667-a97d-824a72f9c9c0/server/0.log" Jul 24 15:22:38.587542 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:38.587507 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-c55zc_9546a497-7d33-4318-9842-704564c2126b/manager/0.log" Jul 24 15:22:38.958788 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:38.958757 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l_04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0/copy-manifests/0.log" Jul 24 15:22:38.965599 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:38.965575 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l_04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0/manager/0.log" Jul 24 15:22:38.972208 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:38.972182 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b042dffc-7a94-4d39-afc1-51ca7fc870a8" path="/var/lib/kubelet/pods/b042dffc-7a94-4d39-afc1-51ca7fc870a8/volumes" Jul 24 15:22:39.421880 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:39.421849 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748405-ld5zf_09cfcbba-b5ba-4d54-bfbc-fdb6a0f7b56b/cleanup/0.log" Jul 24 15:22:41.056041 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:41.056002 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f4f559458-cbpbh_f3723dc8-d99f-40f3-93e4-b46ff24c37e3/authorino/0.log" Jul 24 15:22:41.177473 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:41.177421 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-clq57_7c6fae62-81a5-4558-9b8a-a661c9efab08/manager/0.log" Jul 24 15:22:41.292432 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:41.292402 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tt62v_11d132c6-c031-47d8-9ce7-caecc3b0ed48/manager/0.log" Jul 24 15:22:41.399934 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:41.399859 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fd4dv_04d6fc32-2907-4685-ad95-94d1bcb28b8d/kuadrant-console-plugin/0.log" Jul 24 15:22:41.513840 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:41.513808 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-974jx_2f62de5a-b60c-4dc0-9772-7e13fd62ef02/registry-server/0.log" Jul 24 15:22:41.630490 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:41.630455 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8ftbb_5e4595ab-da83-460e-b387-439b508f201f/manager/0.log" Jul 24 15:22:41.863817 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:41.863784 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dsp9v_dbb9f199-3d86-4786-9690-6acdd382f587/manager/0.log" Jul 24 15:22:42.217307 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:42.217216 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj_8e3ad153-d7a0-4741-9130-f5c7fe1a8b43/istio-proxy/0.log" Jul 24 15:22:42.451805 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:42.451768 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55ffdfd896-vb7sn_d5cd74e8-a47b-4246-afe0-2cce1b110f76/kube-auth-proxy/0.log" Jul 24 15:22:42.684799 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:42.684768 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-smxsr_38085a88-3c89-4270-8eaa-e0cc58066f1b/istio-proxy/1.log" Jul 24 15:22:42.934006 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:42.933971 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-4msfc_4b952219-50d1-4744-b6ce-d52d84e57c80/payload-processing/0.log" Jul 24 15:22:43.064394 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:43.064365 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55c8f8654c-n89nb_22f5a108-29e1-475b-a485-f5b42c371cb9/router/0.log" Jul 24 15:22:43.431795 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:43.431721 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-pm47m_783b7dcf-6c7c-433b-b871-7e1cac52f565/main/0.log" Jul 24 15:22:52.345009 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:52.344976 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2p6b9_7ca81320-80de-485a-8225-cc323e3cefc8/global-pull-secret-syncer/0.log" Jul 24 15:22:52.529378 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:52.529344 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gbj8p_e46c7c4a-495c-4166-b129-ddb313b4731b/konnectivity-agent/0.log" Jul 24 15:22:52.625571 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:52.625475 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-64.ec2.internal_4771bee4c620d4964602556291e24ed3/haproxy/0.log" Jul 24 15:22:56.940815 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:56.940772 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f4f559458-cbpbh_f3723dc8-d99f-40f3-93e4-b46ff24c37e3/authorino/0.log" Jul 24 15:22:57.002639 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:57.002611 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-clq57_7c6fae62-81a5-4558-9b8a-a661c9efab08/manager/0.log" Jul 24 15:22:57.039565 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:57.039537 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tt62v_11d132c6-c031-47d8-9ce7-caecc3b0ed48/manager/0.log" Jul 24 15:22:57.067566 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:57.067523 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fd4dv_04d6fc32-2907-4685-ad95-94d1bcb28b8d/kuadrant-console-plugin/0.log" Jul 24 15:22:57.132905 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:57.132878 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-974jx_2f62de5a-b60c-4dc0-9772-7e13fd62ef02/registry-server/0.log" Jul 24 15:22:57.313708 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:57.313676 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8ftbb_5e4595ab-da83-460e-b387-439b508f201f/manager/0.log" Jul 24 15:22:57.440200 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:57.440169 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dsp9v_dbb9f199-3d86-4786-9690-6acdd382f587/manager/0.log" Jul 24 15:22:59.300462 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:59.300429 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-m72p4_d002916e-5145-4d9a-b074-a5f1ef2a1194/cluster-monitoring-operator/0.log" Jul 24 15:22:59.570232 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:59.570154 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qtjnt_129b2f00-f66b-4a5a-85ed-af4d77638bfe/node-exporter/0.log" Jul 24 15:22:59.593518 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:59.593490 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qtjnt_129b2f00-f66b-4a5a-85ed-af4d77638bfe/kube-rbac-proxy/0.log" Jul 24 15:22:59.615997 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:22:59.615973 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qtjnt_129b2f00-f66b-4a5a-85ed-af4d77638bfe/init-textfile/0.log" Jul 24 15:23:00.300446 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300409 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xkcph"] Jul 24 15:23:00.300808 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300795 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c97d7a5f-0bca-49c8-8caa-93ac2fe65f22" containerName="payload-processing" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300809 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c97d7a5f-0bca-49c8-8caa-93ac2fe65f22" containerName="payload-processing" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300820 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82eae839-deca-4782-9a38-5a5d5062a379" containerName="istio-proxy" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300827 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="82eae839-deca-4782-9a38-5a5d5062a379" containerName="istio-proxy" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300833 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b042dffc-7a94-4d39-afc1-51ca7fc870a8" containerName="istio-proxy" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300839 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b042dffc-7a94-4d39-afc1-51ca7fc870a8" containerName="istio-proxy" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300846 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" containerName="istio-proxy" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300851 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" containerName="istio-proxy" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300859 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2" containerName="payload-pre-processing" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300864 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2" containerName="payload-pre-processing" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300876 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa5569d7-c4b6-4295-b2dc-f04060a5e9dc" containerName="payload-processing" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300881 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa5569d7-c4b6-4295-b2dc-f04060a5e9dc" containerName="payload-processing" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300888 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d6380b7-baf7-415a-b2fa-8702aca6f61d" containerName="payload-processing" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300893 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d6380b7-baf7-415a-b2fa-8702aca6f61d" containerName="payload-processing" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300907 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b15d54e-bc08-42b7-9df3-427193ae03f9" containerName="payload-pre-processing" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300912 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b15d54e-bc08-42b7-9df3-427193ae03f9" containerName="payload-pre-processing" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300964 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a19ba95b-7bed-43b2-bbfb-5fd8d8cf11a2" containerName="payload-pre-processing" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300971 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa5569d7-c4b6-4295-b2dc-f04060a5e9dc" containerName="payload-processing" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300978 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b042dffc-7a94-4d39-afc1-51ca7fc870a8" containerName="istio-proxy" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300984 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="82eae839-deca-4782-9a38-5a5d5062a379" containerName="istio-proxy" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300992 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d6380b7-baf7-415a-b2fa-8702aca6f61d" containerName="payload-processing" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.300999 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" containerName="istio-proxy" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.301004 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b15d54e-bc08-42b7-9df3-427193ae03f9" containerName="payload-pre-processing" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.301009 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" containerName="istio-proxy" Jul 24 15:23:00.301134 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.301015 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c97d7a5f-0bca-49c8-8caa-93ac2fe65f22" containerName="payload-processing" Jul 24 15:23:00.304000 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.303980 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xkcph" Jul 24 15:23:00.312850 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.312818 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xkcph"] Jul 24 15:23:00.389470 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.389438 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6vdz\" (UniqueName: \"kubernetes.io/projected/d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28-kube-api-access-n6vdz\") pod \"kuadrant-operator-catalog-xkcph\" (UID: \"d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28\") " pod="kuadrant-system/kuadrant-operator-catalog-xkcph" Jul 24 15:23:00.491043 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.491005 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6vdz\" (UniqueName: \"kubernetes.io/projected/d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28-kube-api-access-n6vdz\") pod \"kuadrant-operator-catalog-xkcph\" (UID: \"d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28\") " pod="kuadrant-system/kuadrant-operator-catalog-xkcph" Jul 24 15:23:00.499917 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.499888 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6vdz\" (UniqueName: \"kubernetes.io/projected/d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28-kube-api-access-n6vdz\") pod \"kuadrant-operator-catalog-xkcph\" (UID: \"d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28\") " pod="kuadrant-system/kuadrant-operator-catalog-xkcph" Jul 24 15:23:00.615639 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.615558 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xkcph" Jul 24 15:23:00.747837 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.747808 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xkcph"] Jul 24 15:23:00.750466 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:23:00.750440 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b1ee88_2f6f_4fdc_a12c_18cdeab71f28.slice/crio-10cdc8474455633d5cc3ef60d1f51dbbbd56fb352bc0c4872f4b9157dd7ec743 WatchSource:0}: Error finding container 10cdc8474455633d5cc3ef60d1f51dbbbd56fb352bc0c4872f4b9157dd7ec743: Status 404 returned error can't find the container with id 10cdc8474455633d5cc3ef60d1f51dbbbd56fb352bc0c4872f4b9157dd7ec743 Jul 24 15:23:00.751959 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:00.751939 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 15:23:01.511053 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:01.510958 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xkcph" event={"ID":"d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28","Type":"ContainerStarted","Data":"f2c376bc22f8230fa6267ea48eeda3b9a69ea3d2b6bc4b7473cff19b45b470cd"} Jul 24 15:23:01.511053 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:01.511031 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xkcph" event={"ID":"d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28","Type":"ContainerStarted","Data":"10cdc8474455633d5cc3ef60d1f51dbbbd56fb352bc0c4872f4b9157dd7ec743"} Jul 24 15:23:01.526568 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:01.526503 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xkcph" podStartSLOduration=1.116992782 podStartE2EDuration="1.526489227s" totalImagesPullingTime="409.496445ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:23:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:23:01.525756579 +0000 UTC m=+3077.082672472" watchObservedRunningTime="2026-07-24 15:23:01.526489227 +0000 UTC m=+3077.083405127" Jul 24 15:23:01.777722 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:01.777643 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-hsh7p_bea90f67-deec-4a7b-97ec-6491657a3019/networking-console-plugin/0.log" Jul 24 15:23:02.408309 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:02.408278 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/1.log" Jul 24 15:23:02.412210 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:02.412185 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-pn96s_eeddf5b7-07cf-421b-a168-5b67bbb239f1/console-operator/2.log" Jul 24 15:23:02.994742 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:02.994710 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw"] Jul 24 15:23:02.995133 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:02.995082 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82eae839-deca-4782-9a38-5a5d5062a379" containerName="istio-proxy" Jul 24 15:23:02.995133 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:02.995092 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="82eae839-deca-4782-9a38-5a5d5062a379" containerName="istio-proxy" Jul 24 15:23:02.995133 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:02.995100 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b042dffc-7a94-4d39-afc1-51ca7fc870a8" containerName="istio-proxy" Jul 24 15:23:02.995133 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:02.995105 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b042dffc-7a94-4d39-afc1-51ca7fc870a8" containerName="istio-proxy" Jul 24 15:23:02.995133 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:02.995115 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" containerName="istio-proxy" Jul 24 15:23:02.995133 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:02.995120 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ffc064-cc1a-43e6-81cb-66c7fa91a9b1" containerName="istio-proxy" Jul 24 15:23:02.995327 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:02.995197 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b042dffc-7a94-4d39-afc1-51ca7fc870a8" containerName="istio-proxy" Jul 24 15:23:02.995327 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:02.995203 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="82eae839-deca-4782-9a38-5a5d5062a379" containerName="istio-proxy" Jul 24 15:23:02.999170 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:02.999153 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.001325 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.001302 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-84bxh\"/\"kube-root-ca.crt\"" Jul 24 15:23:03.002255 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.002238 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-84bxh\"/\"default-dockercfg-48m4q\"" Jul 24 15:23:03.002336 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.002244 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-84bxh\"/\"openshift-service-ca.crt\"" Jul 24 15:23:03.008842 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.008821 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw"] Jul 24 15:23:03.114110 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.114080 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnh5x\" (UniqueName: \"kubernetes.io/projected/4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb-kube-api-access-nnh5x\") pod \"perf-node-gather-daemonset-42ftw\" (UID: \"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.114298 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.114127 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb-lib-modules\") pod \"perf-node-gather-daemonset-42ftw\" (UID: \"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.114298 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.114162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb-podres\") pod \"perf-node-gather-daemonset-42ftw\" (UID: \"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.114298 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.114189 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb-sys\") pod \"perf-node-gather-daemonset-42ftw\" (UID: \"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.114298 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.114238 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb-proc\") pod \"perf-node-gather-daemonset-42ftw\" (UID: \"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.214915 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.214882 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnh5x\" (UniqueName: \"kubernetes.io/projected/4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb-kube-api-access-nnh5x\") pod \"perf-node-gather-daemonset-42ftw\" (UID: \"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.215108 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.214928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb-lib-modules\") pod \"perf-node-gather-daemonset-42ftw\" (UID: \"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.215108 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.214947 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb-podres\") pod \"perf-node-gather-daemonset-42ftw\" (UID: \"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.215108 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.214972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb-sys\") pod \"perf-node-gather-daemonset-42ftw\" (UID: \"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.215108 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.215016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb-proc\") pod \"perf-node-gather-daemonset-42ftw\" (UID: \"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.215108 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.215087 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb-podres\") pod \"perf-node-gather-daemonset-42ftw\" (UID: \"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.215303 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.215107 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb-sys\") pod \"perf-node-gather-daemonset-42ftw\" (UID: \"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.215303 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.215087 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb-lib-modules\") pod \"perf-node-gather-daemonset-42ftw\" (UID: \"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.215303 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.215126 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb-proc\") pod \"perf-node-gather-daemonset-42ftw\" (UID: \"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.223321 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.223298 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnh5x\" (UniqueName: \"kubernetes.io/projected/4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb-kube-api-access-nnh5x\") pod \"perf-node-gather-daemonset-42ftw\" (UID: \"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb\") " pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.310546 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.310501 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:03.445616 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.445591 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw"] Jul 24 15:23:03.446193 ip-10-0-142-64 kubenswrapper[2581]: W0724 15:23:03.446166 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4d4338b1_9cf3_44ac_9a2a_08e224fdf2cb.slice/crio-a346610a7f48e984164a91ed14a74c787b947fb54702863e72ee98dba189523f WatchSource:0}: Error finding container a346610a7f48e984164a91ed14a74c787b947fb54702863e72ee98dba189523f: Status 404 returned error can't find the container with id a346610a7f48e984164a91ed14a74c787b947fb54702863e72ee98dba189523f Jul 24 15:23:03.522653 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.522626 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" event={"ID":"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb","Type":"ContainerStarted","Data":"a346610a7f48e984164a91ed14a74c787b947fb54702863e72ee98dba189523f"} Jul 24 15:23:03.798023 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:03.797995 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-x2ndk_4b150ceb-025b-45ad-9bca-e9a274b0c418/volume-data-source-validator/0.log" Jul 24 15:23:04.529253 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:04.529216 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" event={"ID":"4d4338b1-9cf3-44ac-9a2a-08e224fdf2cb","Type":"ContainerStarted","Data":"ba3de51db9aaec7a8ed265b6ab7ecce4425ccd0c177e027fffc859490dfcb2c3"} Jul 24 15:23:04.529676 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:04.529289 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:04.547393 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:04.547347 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" podStartSLOduration=2.547324228 podStartE2EDuration="2.547324228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:23:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:23:04.54657985 +0000 UTC m=+3080.103495735" watchObservedRunningTime="2026-07-24 15:23:04.547324228 +0000 UTC m=+3080.104240119" Jul 24 15:23:04.964438 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:04.964362 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mc5kt_e2238818-2359-4792-9170-4294d907f0dc/dns/0.log" Jul 24 15:23:04.984308 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:04.984283 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mc5kt_e2238818-2359-4792-9170-4294d907f0dc/kube-rbac-proxy/0.log" Jul 24 15:23:05.077317 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:05.077285 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mx67k_7843a4ee-c6d1-47b8-b660-84a7a2e49ca8/dns-node-resolver/0.log" Jul 24 15:23:05.707575 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:05.707549 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wsdqx_7703c0af-9df4-4f61-980a-558ccfe28fee/node-ca/0.log" Jul 24 15:23:06.657827 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:06.657791 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj_8e3ad153-d7a0-4741-9130-f5c7fe1a8b43/istio-proxy/0.log" Jul 24 15:23:06.953149 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:06.953067 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55ffdfd896-vb7sn_d5cd74e8-a47b-4246-afe0-2cce1b110f76/kube-auth-proxy/0.log" Jul 24 15:23:07.011691 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:07.011656 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-smxsr_38085a88-3c89-4270-8eaa-e0cc58066f1b/istio-proxy/0.log" Jul 24 15:23:07.036266 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:07.036243 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-smxsr_38085a88-3c89-4270-8eaa-e0cc58066f1b/istio-proxy/1.log" Jul 24 15:23:07.107024 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:07.106993 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-4msfc_4b952219-50d1-4744-b6ce-d52d84e57c80/payload-processing/0.log" Jul 24 15:23:07.129944 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:07.129918 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55c8f8654c-n89nb_22f5a108-29e1-475b-a485-f5b42c371cb9/router/0.log" Jul 24 15:23:08.026258 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:08.026225 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zc6bp_9b40cdad-7cb1-4132-9498-356e139cde9a/serve-healthcheck-canary/0.log" Jul 24 15:23:08.506004 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:08.505979 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-jx44r_1ba79270-3bec-4c43-97f2-3313aed19503/insights-operator/0.log" Jul 24 15:23:08.506893 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:08.506877 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-jx44r_1ba79270-3bec-4c43-97f2-3313aed19503/insights-operator/1.log" Jul 24 15:23:08.548660 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:08.548636 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qqwbj_2d12d587-003d-4a55-b730-17a03d9ab3f9/kube-rbac-proxy/0.log" Jul 24 15:23:08.586613 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:08.586587 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qqwbj_2d12d587-003d-4a55-b730-17a03d9ab3f9/exporter/0.log" Jul 24 15:23:08.619087 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:08.619062 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qqwbj_2d12d587-003d-4a55-b730-17a03d9ab3f9/extractor/0.log" Jul 24 15:23:10.544222 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:10.544194 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-84bxh/perf-node-gather-daemonset-42ftw" Jul 24 15:23:10.616076 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:10.616041 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xkcph" Jul 24 15:23:10.616263 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:10.616106 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xkcph" Jul 24 15:23:10.638445 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:10.638418 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xkcph" Jul 24 15:23:11.585694 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:11.585667 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xkcph" Jul 24 15:23:11.624340 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:11.624312 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xkcph"] Jul 24 15:23:11.764695 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:11.764672 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-j447f_90c483e5-7333-4667-a97d-824a72f9c9c0/server/0.log" Jul 24 15:23:11.847923 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:11.847837 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-c55zc_9546a497-7d33-4318-9842-704564c2126b/manager/0.log" Jul 24 15:23:12.080683 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:12.080653 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l_04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0/manager/0.log" Jul 24 15:23:12.105843 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:12.105768 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cffdd4dd6-b4k2l_04c5cfc3-d2c4-49d1-b859-4f7b020bcfe0/copy-manifests/0.log" Jul 24 15:23:13.574985 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:13.574943 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-xkcph" podUID="d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28" containerName="registry-server" containerID="cri-o://f2c376bc22f8230fa6267ea48eeda3b9a69ea3d2b6bc4b7473cff19b45b470cd" gracePeriod=2 Jul 24 15:23:13.654662 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:13.654637 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj_8e3ad153-d7a0-4741-9130-f5c7fe1a8b43/istio-proxy/0.log" Jul 24 15:23:13.832858 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:13.832802 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xkcph" Jul 24 15:23:13.912359 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:13.912325 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6vdz\" (UniqueName: \"kubernetes.io/projected/d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28-kube-api-access-n6vdz\") pod \"d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28\" (UID: \"d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28\") " Jul 24 15:23:13.914335 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:13.914311 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28-kube-api-access-n6vdz" (OuterVolumeSpecName: "kube-api-access-n6vdz") pod "d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28" (UID: "d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28"). InnerVolumeSpecName "kube-api-access-n6vdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:23:13.937540 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:13.937514 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55ffdfd896-vb7sn_d5cd74e8-a47b-4246-afe0-2cce1b110f76/kube-auth-proxy/0.log" Jul 24 15:23:13.971000 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:13.970969 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-smxsr_38085a88-3c89-4270-8eaa-e0cc58066f1b/istio-proxy/0.log" Jul 24 15:23:13.998736 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:13.998707 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-smxsr_38085a88-3c89-4270-8eaa-e0cc58066f1b/istio-proxy/1.log" Jul 24 15:23:14.013464 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:14.013432 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6vdz\" (UniqueName: \"kubernetes.io/projected/d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28-kube-api-access-n6vdz\") on node \"ip-10-0-142-64.ec2.internal\" DevicePath \"\"" Jul 24 15:23:14.048266 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:14.048240 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-4msfc_4b952219-50d1-4744-b6ce-d52d84e57c80/payload-processing/0.log" Jul 24 15:23:14.065900 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:14.065881 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55c8f8654c-n89nb_22f5a108-29e1-475b-a485-f5b42c371cb9/router/0.log" Jul 24 15:23:14.581178 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:14.581148 2581 generic.go:356] "Generic (PLEG): container finished" podID="d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28" containerID="f2c376bc22f8230fa6267ea48eeda3b9a69ea3d2b6bc4b7473cff19b45b470cd" exitCode=0 Jul 24 15:23:14.581600 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:14.581229 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xkcph" Jul 24 15:23:14.581600 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:14.581240 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xkcph" event={"ID":"d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28","Type":"ContainerDied","Data":"f2c376bc22f8230fa6267ea48eeda3b9a69ea3d2b6bc4b7473cff19b45b470cd"} Jul 24 15:23:14.581600 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:14.581292 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xkcph" event={"ID":"d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28","Type":"ContainerDied","Data":"10cdc8474455633d5cc3ef60d1f51dbbbd56fb352bc0c4872f4b9157dd7ec743"} Jul 24 15:23:14.581600 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:14.581312 2581 scope.go:117] "RemoveContainer" containerID="f2c376bc22f8230fa6267ea48eeda3b9a69ea3d2b6bc4b7473cff19b45b470cd" Jul 24 15:23:14.590478 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:14.590459 2581 scope.go:117] "RemoveContainer" containerID="f2c376bc22f8230fa6267ea48eeda3b9a69ea3d2b6bc4b7473cff19b45b470cd" Jul 24 15:23:14.590775 ip-10-0-142-64 kubenswrapper[2581]: E0724 15:23:14.590751 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2c376bc22f8230fa6267ea48eeda3b9a69ea3d2b6bc4b7473cff19b45b470cd\": container with ID starting with f2c376bc22f8230fa6267ea48eeda3b9a69ea3d2b6bc4b7473cff19b45b470cd not found: ID does not exist" containerID="f2c376bc22f8230fa6267ea48eeda3b9a69ea3d2b6bc4b7473cff19b45b470cd" Jul 24 15:23:14.590857 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:14.590786 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2c376bc22f8230fa6267ea48eeda3b9a69ea3d2b6bc4b7473cff19b45b470cd"} err="failed to get container status \"f2c376bc22f8230fa6267ea48eeda3b9a69ea3d2b6bc4b7473cff19b45b470cd\": rpc error: code = NotFound desc = could not find container \"f2c376bc22f8230fa6267ea48eeda3b9a69ea3d2b6bc4b7473cff19b45b470cd\": container with ID starting with f2c376bc22f8230fa6267ea48eeda3b9a69ea3d2b6bc4b7473cff19b45b470cd not found: ID does not exist" Jul 24 15:23:14.605829 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:14.605798 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xkcph"] Jul 24 15:23:14.613227 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:14.611664 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xkcph"] Jul 24 15:23:14.972329 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:14.972293 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28" path="/var/lib/kubelet/pods/d9b1ee88-2f6f-4fdc-a12c-18cdeab71f28/volumes" Jul 24 15:23:15.485702 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:15.485674 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6bnjj_8e3ad153-d7a0-4741-9130-f5c7fe1a8b43/istio-proxy/0.log" Jul 24 15:23:15.775556 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:15.775458 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55ffdfd896-vb7sn_d5cd74e8-a47b-4246-afe0-2cce1b110f76/kube-auth-proxy/0.log" Jul 24 15:23:15.812397 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:15.812366 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-smxsr_38085a88-3c89-4270-8eaa-e0cc58066f1b/istio-proxy/0.log" Jul 24 15:23:15.844949 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:15.844917 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-smxsr_38085a88-3c89-4270-8eaa-e0cc58066f1b/istio-proxy/1.log" Jul 24 15:23:15.900128 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:15.900099 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-4msfc_4b952219-50d1-4744-b6ce-d52d84e57c80/payload-processing/0.log" Jul 24 15:23:15.914130 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:15.914107 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55c8f8654c-n89nb_22f5a108-29e1-475b-a485-f5b42c371cb9/router/0.log" Jul 24 15:23:18.564061 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:18.564029 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-dmpsc_d749a88e-2437-4fbf-8ba7-80ef1759d043/migrator/0.log" Jul 24 15:23:18.588108 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:18.588083 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-dmpsc_d749a88e-2437-4fbf-8ba7-80ef1759d043/graceful-termination/0.log" Jul 24 15:23:18.970316 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:18.970214 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w_34244aba-7d82-4b4e-aac5-216ee4e6bbaa/kube-storage-version-migrator-operator/1.log" Jul 24 15:23:18.971234 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:18.971202 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-lxx6w_34244aba-7d82-4b4e-aac5-216ee4e6bbaa/kube-storage-version-migrator-operator/0.log" Jul 24 15:23:19.943968 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:19.943941 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gqx2c_f801522b-b504-4771-bfd2-0f4f0d52affd/kube-multus-additional-cni-plugins/0.log" Jul 24 15:23:19.968280 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:19.968259 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gqx2c_f801522b-b504-4771-bfd2-0f4f0d52affd/egress-router-binary-copy/0.log" Jul 24 15:23:19.993029 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:19.992993 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gqx2c_f801522b-b504-4771-bfd2-0f4f0d52affd/cni-plugins/0.log" Jul 24 15:23:20.017022 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:20.016998 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gqx2c_f801522b-b504-4771-bfd2-0f4f0d52affd/bond-cni-plugin/0.log" Jul 24 15:23:20.041765 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:20.041740 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gqx2c_f801522b-b504-4771-bfd2-0f4f0d52affd/routeoverride-cni/0.log" Jul 24 15:23:20.064053 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:20.064026 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gqx2c_f801522b-b504-4771-bfd2-0f4f0d52affd/whereabouts-cni-bincopy/0.log" Jul 24 15:23:20.086072 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:20.086053 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gqx2c_f801522b-b504-4771-bfd2-0f4f0d52affd/whereabouts-cni/0.log" Jul 24 15:23:20.556037 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:20.556008 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vwgvc_38648634-ad37-495e-993d-e18db1878323/kube-multus/0.log" Jul 24 15:23:20.583647 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:20.583618 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7s68w_22897615-e1fd-4eb7-9694-81b23695e7a5/network-metrics-daemon/0.log" Jul 24 15:23:20.604284 ip-10-0-142-64 kubenswrapper[2581]: I0724 15:23:20.604260 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7s68w_22897615-e1fd-4eb7-9694-81b23695e7a5/kube-rbac-proxy/0.log"